Skip to content

AI training data for regional languages

Speech, text, RLHF and evaluation data in Turkish, Arabic, Persian, Balkan, Eastern European and Turkic languages, collected and checked by native speakers. Start with a free pilot batch of up to 100 annotated samples or 30 minutes of audio, with a QA report.

Why AI models need regional training data.

Most AI models are trained mainly on English and Western European languages. In Turkish, Arabic, Persian, Balkan, Eastern European and Turkic languages they struggle with:

Arabic dialect diversity
Gulf, Levantine, Egyptian and Maghrebi dialects differ substantially from Modern Standard Arabic.
Balkan language gap
Serbian, Croatian and Bosnian have few public datasets for hate speech detection and sentiment analysis.
Cultural nuance
Idioms, humor and cultural references are lost without native human validation.

How we address it.

Native speakers collect, annotate and check every dataset. Projects run under an ISO/IEC 27001 certified information security management system, with in-house project management and QA, and data is delivered in batches so model teams can start on early batches while collection continues.

  • Native speaker data collection across major dialects
  • Human-in-the-loop validation for every dataset
  • Cultural and linguistic quality assurance
  • Ethical sourcing with contributor consent
  • ISO/IEC 27001 certified information security

AI data services.

From speech collection and image labeling to human feedback and custom MT training data: the data your models need to work in regional languages.

01

Audio and speech data collection

Recordings from native speakers, balanced by accent, age, gender and acoustic environment. Collection focuses on dialects and regional languages that off-the-shelf speech corpora leave out.

Languages
  • Turkish
  • Arabic (MSA and regional dialects)
  • Persian
  • Balkan languages
  • Other regional languages we cover
Use cases
  • Voice assistants and smart speakers
  • Call center automation
  • In-vehicle voice systems
  • Speech-to-text engines
02

RLHF and human feedback

Native linguists compare and rank LLM outputs, check facts and judge whether an answer suits the culture of the reader. The ratings feed alignment and fine-tuning for regional languages.

Languages
  • All 19 regional languages
Use cases
  • LLM alignment and fine-tuning
  • Chatbot quality improvement
  • AI safety and guardrails
  • Instruction tuning

Human evaluation of AI and MT output

03

Content moderation data

Labeled datasets for hate speech, toxicity, misinformation and sentiment. Our annotators understand the slang, code-switching and cultural context that automated systems miss.

Languages
  • Balkan languages
  • Arabic dialects
  • Turkish
Use cases
  • Social platform moderation
  • Marketplace trust and safety
  • Sentiment analysis
  • Misinformation detection
04

Text and NLP datasets

Annotated and labeled text for named entity recognition, classification and intent detection in regional languages and dialects, built to your schema or ours.

Languages
  • All 19 regional languages
Use cases
  • Machine translation training
  • Named entity recognition
  • Text classification and tagging
  • Intent detection for chatbots
05

Custom MT and LLM training

Parallel corpora, domain-specific datasets and evaluation sets for fine-tuning machine translation engines and large language models on your domain and terminology, with output benchmarked by native linguists.

Languages
  • All 19 regional languages
Use cases
  • Enterprise MT engine training
  • Domain-specific LLM fine-tuning
  • Terminology and style adaptation
  • MT quality benchmarking
06

Image labeling and computer vision annotation

Images and video frames labeled with bounding boxes, polygons, segmentation masks or classes. Native annotators read the regional signage, packaging and documents that generic teams get wrong.

Languages
  • Arabic and Persian script
  • Turkish text
  • Language-independent imagery
Use cases
  • Retail and product recognition
  • Document and receipt OCR
  • Mapping and street-level imagery
  • Image content moderation

Free pilot batch

Test us before you commit.

Send us your spec and we will deliver a free pilot batch of up to 100 annotated samples or 30 minutes of collected audio, with a QA report included. You evaluate the output against your own acceptance criteria before committing to production.

Datasheet

The technical details, up front.

What you get, how it is checked and how it is delivered, before you get on a call.

Formats and delivery

  • Text: JSONL, CSV/TSV, XLIFF or your custom schema
  • Audio: WAV or FLAC, 16 to 48 kHz, with speaker and environment metadata
  • Time-aligned transcripts: TextGrid, SRT, VTT
  • RLHF: ranking and rating exports matched to your pipeline format
  • Delivery via secure transfer, API or your own platform

Quality methodology

  • Annotation guidelines co-developed with you, versioned per batch
  • Calibration rounds before production starts
  • Gold tasks seeded throughout, with annotators tracked against them
  • Inter-annotator agreement (IAA) measured and reported per delivery
  • WER spot-checks on transcription, with acceptance criteria agreed up front

From requirements to delivery.

  1. Requirements analysis

    We review your model needs, target languages and data specifications.

  2. Contributor sourcing

    Native speakers are drawn from our network of 700+ approved linguists and contributors.

  3. Collection and annotation

    Work runs in batches against the agreed guidelines, with gold tasks and spot checks on each batch.

  4. Validation and delivery

    Final human review and formatting, ready for your pipeline.

Data security

Your data never trains public models.

Data leakage is a common concern in enterprise AI projects. Your proprietary data is used only for your project, access is limited to the assigned team and all work runs under NDA and our ISO/IEC 27001 certified information security management system. More in the FAQ on security and compliance.

ISO/IEC 27001
Certified information security management system
NDA coverage
NDA signed by every linguist and annotator
Limited access
Access limited to the team assigned to your project
GDPR
GDPR-aligned data handling

AI data projects we have delivered.

Client projects. Names withheld under NDA; references available on request.

AI/ML

Global tech company

Challenge
An ASR model needed Turkish speech from speakers across regions, ages and acoustic environments, which public corpora do not cover.
What we did
Recruited native speakers across Türkiye, including Istanbul, Aegean, Black Sea and Eastern accents, then recorded them in homes, cars, offices and public spaces, with transcripts time-aligned to the recordings.
What made it work
  • Speaker quotas by region, age and gender agreed before recording started, so coverage was by design rather than by chance
  • Acceptance criteria and WER spot-check thresholds agreed up front
  • Multi-tier validation per batch, with rejected recordings re-collected before delivery

Content moderation

Social media platform

Challenge
Hate speech detection trained on Modern Standard Arabic was failing on Gulf, Levantine and Egyptian posts, where slang and code-switching carry the meaning.
What we did
Built a hate speech and toxicity dataset across Gulf, Levantine, Egyptian and Maghrebi Arabic and MSA, labeled by native annotators from each dialect region.
What made it work
  • Annotation guidelines co-developed with the client trust and safety team and versioned per batch
  • Calibration rounds before production, with annotators tracked against gold tasks
  • Inter-annotator agreement measured and reported with every delivery

LLM training

AI startup

Challenge
A Turkish-language LLM needed RLHF data for instruction tuning and alignment. No suitable dataset existed.
What we did
Provided a dedicated annotator team for response ranking, quality scoring and prompt evaluation, with linguists from business, legal and medical backgrounds on the domain prompts.
What made it work
  • Rating rubric co-developed with the client and tested on a pilot batch before production
  • Domain prompts routed to annotators with matching subject experience
  • Inter-annotator agreement reported per batch, with disagreements reviewed and the rubric updated

FAQ

AI training data questions

Answers for AI and ML teams scoping speech, text or evaluation data in regional languages.

Which languages and dialects can El Turco collect speech data in?

El Turco collects speech data in Turkish, Arabic, Persian, the Balkan languages and the other regional languages it covers, with native speakers recorded across accents, ages, genders and acoustic environments. Arabic projects can record speakers from the Gulf, Levantine, Egyptian and Maghrebi dialect regions and add Modern Standard Arabic where the model needs it. Turkish collection can span regional accents such as Istanbul, Aegean, Black Sea and Eastern speech.

How long does an AI data project take?

Timelines for El Turco AI data projects are agreed at scoping, because they depend on data type, volume, dialect coverage, contributor profiles and the QA steps required. Data is usually delivered in batches, so model teams can start working with early batches while collection continues. The free pilot batch comes first and sets the baseline for the production schedule.

Can El Turco annotate inside our own tool and schema?

Yes. El Turco annotators can work inside a client's own platform or annotation tool, or deliver into a custom schema agreed at the start. Guidelines are co-developed with the client and versioned per batch, so label definitions stay stable as the project grows. When the client has no platform of its own, data is delivered through secure transfer or API.

Can El Turco evaluate LLM and machine translation output?

Yes. El Turco linguists evaluate LLM responses and machine translation output in their native languages, scoring accuracy, fluency, cultural appropriateness and terminology against an agreed rubric. Evaluation sets can be built from the client domain content and rerun after each model update. Teams then benchmark progress in Turkish, Arabic, Persian and the other languages El Turco covers.

Who are the El Turco contributors and annotators?

El Turco contributors and annotators are native speakers drawn from a network of 700+ approved linguists and contributors across Türkiye, the Middle East, the Balkans, Eastern Europe, the Caucasus and Central Asia. Each contributor is matched to the language, dialect and profile the project needs. Annotators are calibrated on the client guidelines before production and tracked against gold tasks throughout the work.

How does El Turco handle contributor consent and data usage rights?

El Turco contributors give consent before any recording or annotation starts, and every linguist and annotator signs an NDA. Speech and text data is handled in a GDPR-aligned way under the ISO/IEC 27001 certified information security management system. Usage terms for each dataset are set out in the project agreement, so the AI team knows how the delivered data can be used for model training.

Talk to us about your AI data project.

Share your languages, data type and volume. We reply with a spec, a timeline and a quote. Pricing is per-word, hourly or project-based, quoted after scoping.

Discuss your AI data project Translation and localization

A project manager reads your brief, usually the same working day.