LitCoin NLP Challenge | bitgrit
Competition banner

LitCoin NLP Challenge

Develop an NLP algorithm that accurately shows the information marked in free text and output it through knowledge graph

NCATS & NASA
2 Participants
1 Submission
bitgrit twitter
Brief
This is a 2-part data challenge made possible by NCATS and NCBI. Each part of the challenge is designed to [...] *NOTE: The prize money displayed is the total prize for both of LitCoin NLP Challenges. Please see the Rules section for more info* NCATS (one of the branches of NIH): NCATS, is conducting this challenge under the America Creating Opportunities to Meaningfully Promote Excellence in Technology, Education, and Science (COMPETES) Reauthorization Act of 2010. This challenge will spur innovation in NLP to advance the field and allow the generation of more accurate and useful data from biomedical publications, which will enhance the ability for data scientists to create tools to foster discovery and generate new hypotheses. NCBI (a collaborator): NCATS, in collaboration with NCBI, will share with the participants an open repository containing abstracts derived from published scientific research articles and knowledge assertions between concepts within these abstracts. CrowdPlat (Project Company): The LitCoin project was awarded to and is being managed by CrowdPlat under NASA's NOIS2 contract. Located in San Jose, California; CrowdPlat provides crowdsourcing solutions to medium to large scale enterprises seeking project execution through a crowdsourced talent pool.
Prizes
  • 1st Prize ($ 35000)

    The prize money displayed is the total prize for both LitCoin Challenges. Please see the Rules section for more info!
  • 2nd Prize ($ 25000)

    The prize money displayed is the total prize for both LitCoin Challenges. Please see the Rules section for more info!
  • 3rd Prize ($ 20000)

    The prize money displayed is the total prize for both LitCoin Challenges. Please see the Rules section for more info!
  • 4th Prize ($ 5000)

    The prize money displayed is the total prize for both LitCoin Challenges. Please see the Rules section for more info!
  • 5th Prize ($ 5000)

    The prize money displayed is the total prize for both LitCoin Challenges. Please see the Rules section for more info!
  • 6th Prize ($ 5000)

    The prize money displayed is the total prize for both LitCoin Challenges. Please see the Rules section for more info!
  • 7th Prize ($ 5000)

    The prize money displayed is the total prize for both LitCoin Challenges. Please see the Rules section for more info!
Timeline
  • 01 Nov 2021 Competition Starts
  • 15 Feb 2022 Competition Ends
  • 23 Mar 2022 Winners Announced (Subject to change based on submission results)
Data Breakdown
[Here will be the guidelines of the competition]
FAQs
Who do I contact if I need help regarding a competition?
If you have any inquiries about participating in this competition, please don’t hesitate to reach out to us at [email protected]. For questions about eligibility or prize distribution, email NCATS at [email protected].
How will I know if I’ve won?
If you are one of the top seven winners for this competition, we will email you with the final result and information about how to claim your reward.
How can I report a bug?
Please shoot us an email at [email protected] with details and a description of the bug you are facing, and if possible, please attach a screenshot of the bug itself.
If I win, how can I receive my reward?
The money prize will be awarded by NIH/NCATS directly to the winner (if an individual) or Team Lead of the winning team (if a team). Prizes awarded under this Challenge will be paid by electronic funds transfer and may be subject to Federal income taxes. HHS/NIH will comply with the Internal Revenue Service withholding and reporting requirements, where applicable.
Rules
1. This competition is governed by the following Terms of Participation (“Participation Rules”). Participants must agree to and comply with the Participation Rules to compete. 2. Participants are allowed to participate as in an individual capacity or as teams. 3. In order to participate in this competition and be eligible for the prize money, participants must be a U.S. citizen or a U.S. permanent resident. Non-U.S. citizens and non-permanent residents can participate as well, as a member of a team that includes a citizen or permanent resident of the U.S, or they can participate on their own. However, such non-U.S. citizens and non-permanent residents are not eligible to win a monetary prize (in whole or in part). Their participation as part of a winning team, if applicable, may be recognized when the results are announced. Similarly, if participating on their own, they may be eligible to win a non-cash recognition prize. Proof of citizenship and permanent residency will be required. For more information on competition eligibility requirements, please see https://ncats.nih.gov/challenges/litcoin 4. In the case of a team participation, all submissions must be made by the team lead. 5. The use of external datasets for the purposes of training is allowed, but submissions must be generated by the test corpus provided. 6. During the competition period, participants will be allowed to submit a maximum number of 5 submissions per day. If participants exceed the set submission limit, the platform will be reset to allow additional 5 submissions the following day. Please keep this in mind when uploading a submission file. Any attempt to circumvent stated limits will result in disqualification. 7. Participants are not permitted to share or upload the competition dataset to any platform outside of competition. Participants that do not comply with the confidentiality regulations of the competition will be disqualified. 8. The top seven (7) winning participants will be eligible to receive a competition prize (ranked by performance) after we have received, successfully executed, and confirmed the validity of both the code and the solution (See 10.). In order to ensure that at least 7 participants may be awarded prizes, the top fifteen (15) individuals/teams will be asked to submit their source code for evaluation (see 9.). 9. Once potential competition winners are determined and our team reaches out to them, the top scoring participants must provide the following by February 10, 2022 for evaluation to be qualified as competition winner(s) and receive their prize:   a.Winning Model Documentation template filled in (this document is available on the “Resources” tab on the competition page)   b. All source files required to preprocess the data   c. All source files required to build, train and make predictions with the model using the processed data   d. A requirements.txt (or equivalent) file indicating all the required libraries and their versions as needed   e. A ReadMe file containing the following:    • Clear and unambiguous instructions on how to reproduce the predictions from start to finish including data pre-processing, feature extraction, model training and predictions generation • Environment details regarding where the model was developed and trained, including OS, memory (RAM), disk space, CPU/GPU used, and any required environment configurations required to execute the code • Clear answers to the following questions: - Which data files are being used? - How are these files processed? - What is the algorithm used and what are its main hyperparameters? - Any other comments considered relevant to understanding and using the model 10. Solution submissions should be able to generate the exact output that gives the corresponding score on the leaderboard. If the score obtained from the code is different from what’s shown on the leaderboard, the new score (which may be lower) will be used for the final rankings unless a logical explanation is provided. Please make sure to set the seed or random_state etc. so we can obtain the same result from your code. 11. Solution submissions will also be used to generate output based on a validation dataset, generated in the same manner with which the provided test and training sets were generated, which will be kept hidden from all participants, in order to verify that code was not customized for the provided dataset. This output will not be used to determine leaderboard position, but could be used to disqualify a participant from receiving a prize if the output is judged to be severely inaccurate by bitgrit, CrowdPlat and NCATS. 12. In order to be eligible for the prize, a competition winner (whether an individual, group of individuals, or entity) must agree to grant to the NIH an irrevocable, paid-up, royalty-free non-exclusive worldwide license to reproduce, publish, post, link to, share, and display publicly the submission on the web or elsewhere, and a nonexclusive, non transferable, irrevocable, paid-up license to practice or have practiced for or on its behalf, the solution throughout the world. For more detailed information, please visit http://ncats.nih.gov/challenges/litcoin. 13. Any prize awards are subject to verification of eligibility and compliance with these Participation Rules. Novelty and innovation of submissions may also affect the final ranking. All decisions of bitgrit, CrowdPlat and NCATS will be final and binding on all matters relating to this Competition. 14. Cash prizes will be paid directly by NIH/NCATS to the competition winners. In the case of a winning team, the money prize will be paid directly by NIH/NCATS to the Team Lead. Non-U.S. citizens and non-permanent residents are not eligible to receive a cash prize (in whole or in part). Their participation as part of a winning team, if applicable, may be recognized when the results are announced. Payments to winners may be subject to local, state, federal and foreign tax reporting and withholding requirements. 15. If two or more participants have the same score on the leaderboard, an earlier submission will take precedence and be ranked higher than a later submission. 16. If you have any inquiries about participating in this competition, please don’t hesitate to reach out to us at [email protected]. For questions about eligibility or prize distribution, email NCATS at [email protected].
New Submission
Step 1
Upload or drop your file
Upload or drop your csv file here.
Your submission should be in .csv format.
Step 2
Description
Briefly describe your submission (400 characters or less)

You have exceeded the number of allowed submissions for this competition.
5 submission(s) left

Thanks for your submission!

We'll send updates to your email. You can check your email and preferences here.
My Submissions
.