cli.eval.ai Open in urlscan Pro
185.199.109.153  Public Scan

Form analysis
0 forms found in the DOM

Text Content

EvalAI
 * Forum
 * Contact Us
 * GitHub


USE EVALAI THROUGH COMMAND LINE

Make submissions to a challenge with a single command

Check the real-time status of your submissions through your terminal

See Examples


WHAT IS EVALAI-CLI?

EvalAI-CLI is designed to extend the functionality of the EvalAI web application
to your command line to make the platform more accessible and terminal-friendly
to its users.


GET STARTED

INSTALL EVALAI FROM PYPI


Run this command
pip install evalai

CONFIGURE YOUR AUTH TOKEN


Run this command
evalai set_token <auth_token>

VIEW YOUR AUTH TOKEN


Run this command
evalai get_token


EXAMPLES



CHALLENGE

--------------------------------------------------------------------------------

DISPLAY ALL CHALLENGES

Run this command
evalai challenges

DISPLAY ALL ONGOING CHALLENGES

Run this command
evalai challenges ongoing

DISPLAY ALL UPCOMING CHALLENGES

Run this command
evalai challenges future

DISPLAY ALL PAST CHALLENGES

Run this command
evalai challenges past

DISPLAY DETAILS OF A CHALLENGE WITH ID 1

Run this command
evalai challenge 1

DISPLAY ALL CHALLENGES THAT YOU'VE PARTICIPATED IN

Run this command
evalai challenges --participant

DISPLAY ALL CHALLENGES THAT YOU'VE HOSTED

Run this command
evalai challenges --host



CHALLENGE PHASE

--------------------------------------------------------------------------------

DISPLAY ALL CHALLENGE PHASES OF THE CHALLENGE WITH CHALLENGE ID 1

Run this command
evalai challenge 1 phases

DISPLAY THE DETAILS OF THE PHASE WITH ID 4 OF THE CHALLENGE WITH ID 1

Run this command
evalai challenge 1 phase 4



TEAMS

--------------------------------------------------------------------------------

PARTICIPATE IN A CHALLENGE WITH ID 1 AND TEAM ID 2

Run this command
evalai challenge 1 participate 2

VIEW YOUR PARTICIPANT TEAMS

Run this command
evalai teams --participant

VIEW YOUR HOST TEAMS

Run this command
evalai teams --host

CREATE A PARTICIPANT TEAM

Run this command
evalai teams create participant

CREATE A HOST TEAM

Run this command
evalai teams create host



LEADERBOARDS AND SUBMISSIONS

--------------------------------------------------------------------------------

MAKE A SUBMISSION TO THE PHASE 4 OF A CHALLENGE WITH ID 1

IF CHALLENGE 1 IS DOCKER BASED

Run this command
evalai push <image:tag> -p 4

IF CHALLENGE 1 IS DOCKER BASED AND YOU WANT TO MAKE PRIVATE SUBMISSION

Run this command
evalai push <image:tag> -p 4 --private

IF CHALLENGE 1 IS DOCKER BASED AND YOU WANT TO MAKE PUBLIC SUBMISSION

Run this command
evalai push <image:tag> -p 4 --public

IF CHALLENGE 1 IS NOT DOCKER BASED

Run this command
evalai challenge 1 phase 4 submit --file submission.json

IF CHALLENGE 1 IS NOT DOCKER BASED AND SUBMISSION FILE IS > 400 MB

Run this command
evalai challenge 1 phase 4 submit --file submission.json --large

IF CHALLENGE 1 IS NOT DOCKER BASED AND YOU WANT TO MAKE PRIVATE SUBMISSION

Run this command
evalai challenge 1 phase 4 submit --file submission.json --private

IF CHALLENGE 1 IS NOT DOCKER BASED AND YOU WANT TO MAKE PUBLIC SUBMISSION

Run this command
evalai challenge 1 phase 4 submit --file submission.json --public

VIEW STATUS OF A SUBMISSION WITH ID 78

Run this command
evalai submission 78

GET ALL THE PHASE SPLITS OF THE CHALLENGE 1 WITH PHASE 4

Run this command
evalai challenge 1 phase 4 splits

VIEW THE LEADERBOARD OF CHALLENGE 1 WITH CHALLENGE PHASE SPLIT 4

Run this command
evalai challenge 1 leaderboard 4

VIEW ALL THE SUBMISSIONS TO PHASE 4 OF THE CHALLENGE 1

Run this command
evalai challenge 1 phase 4 submissions

VIEW ALL THE SUBMISSIONS TO PHASE 4 OF THE CHALLENGE 1 BETWEEN 06/15/18 AND
06/25/18

Run this command
evalai challenge 1 phase 4 submissions -s 06/15/18 -e 06/25/18



CHALLENGE ANNOTATIONS

--------------------------------------------------------------------------------

UPLOAD CHALLENGE PHASE ANNOTATIONS IF USER IS CHALLENGE HOST

Run this command
evalai challenge 1 phase 4 submit --file annotation.json --annotation

UPLOAD CHALLENGE PHASE ANNOTATIONS > 400MB IF USER IS CHALLENGE HOST

Run this command
evalai challenge 1 phase 4 submit --file annotation.json --large --annotation



CONFIGURE YOUR CUSTOM BACKEND

--------------------------------------------------------------------------------

CONFIGURE THE HOST URL (OPTIONAL)

Only run the following command if you want to use CLI with your forked version
of EvalAI.

Run this command
evalai host -sh https://eval.ai

Maintained by EvalAI Team
©2023 EvalAI