Data is available currently for the following languages. This data can be freely used for non-profit research work under the Creative Commons License.

Training Data

• Hindi (Annotated, UTF-8): tar file, zip file
• Hindi (Annotated, WX): tar file, zip file
• Hindi (Raw, UTF-8): tar file, zip file
• Hindi (Raw, WX): tar file, zip file

• Bengali (Annotated, UTF-8): tar file, zip file
• Bengali (Annotated, WX): tar file, zip file
• Bengali (Raw, UTF-8): tar file, zip file
• Bengali (Raw, WX): tar file, zip file

• Oriya (Annotated, UTF-8): tar file, zip file
• Oriya (Annotated, WX): tar file, zip file
• Oriya (Raw, UTF-8): tar file, zip file
• Oriya (Raw, WX): tar file, zip file

• Telugu (Annotated, WX): tar file, zip file
• Telugu (Raw, WX): tar file, zip file

• Urdu (Annotated, UTF-8): tar file, zip file
• Urdu (Annotated, Roman): tar file, zip file
• Urdu (Raw, UTF-8): tar file, zip file
• Urdu (Raw, Roman): tar file, zip file

Test Data

• Hindi (Raw, UTF-8): tar file, zip file
• Hindi (Raw, WX): tar file, zip file
• Hindi (Annotated, UTF-8): tar file, zip file
• Hindi (Annotated, WX): tar file, zip file

• Bengali (Raw, UTF-8): tar file, zip file
• Bengali (Raw, WX): tar file, zip file
• Bengali (Annotated, UTF-8): tar file, zip file
• Bengali (Annotated, WX): tar file, zip file

• Oriya (Raw, UTF-8): tar file, zip file
• Oriya (Raw, WX): tar file, zip file
• Oriya (Annotated, UTF-8): tar file, zip file
• Oriya (Annotated, WX): tar file, zip file

• Telugu (Raw, WX): tar file, zip file
• Telugu (Annotated, WX): tar file, zip file

• Urdu (Raw, UTF-8): tar file, zip file
• Urdu (Raw, Roman): tar file, zip file
• Urdu (Annotated, UTF-8): tar file, zip file
• Urdu (Annotated, Roman): tar file, zip file

Please see the submission and FAQ pages to avoid mistakes.