Back to SFT Studio Pro

TRiAD Ai

SFT Studio Pro

Supervised Fine-Tuning Synthesis Workspace

A complete, sequential guide to project onboarding, data creation, document conversion, quality assurance, registry management, automated model training, and your free model sample.

Table of Contents

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Welcome to SFT Studio Pro

SFT Studio Pro is a workspace for building supervised fine-tuning (SFT) datasets and moving them through a connected workflow: complete project onboarding, create or convert examples, review batches, assemble the approved corpus, train a model, and try it with a free model chat sample.

This manual follows the order in which the work is completed in the application. It includes SFT background, dataset planning, project onboarding and definition, automated and manual batch generation, the Document Converter, the optional FTK TRiAD alignment corpus, QA, the Dataset Registry, Automated Training, and model access.

Understanding SFT

Supervised fine-tuning is teaching by example. A model is shown examples of inputs and the responses desired for those inputs. Across the training examples, the model learns patterns in format, voice, content, and response style. An SFT example may be an instruction-response item or a multi-turn conversation, depending on the project's selected example type.

The completed dataset is a collection of structured examples. SFT Studio Pro organizes these examples in batches so they can be generated or imported, reviewed, and approved before being added to the project corpus.

Planning the dataset

There is no single correct dataset size for every project. The amount of data depends on the model, the range of tasks, and the intended identity and capabilities of the finished model. A focused assistant with a narrow purpose can be well served by a smaller, carefully reviewed corpus, while a model expected to handle varied requests benefits from broader coverage.

Quality matters more than raw count. A modest set of accurate, consistent, well-structured examples usually outperforms a larger set that is uneven. Because the app builds the dataset in batches, you can start with a core set of topics and grow the corpus incrementally — reviewing each batch as it arrives rather than committing to a final size up front.

Quality and coverage

A dataset can contain many examples and still cover only a narrow range of situations. Coverage means the corpus spans the skills, subjects, and interaction types the model will face — including varied phrasings, different difficulty levels, short and extended exchanges, and ambiguous requests.

Quality is enforced at two points. First, the golden example approved during onboarding defines the structure and standard every generated example follows. Later, Quality Assurance analyzes each generated or converted batch, flags potentially problematic examples with written explanations, and leaves the final approval decision to you.

Training Corpus and Validator

The batches you select in the Dataset Registry compile into the project corpus. During Compile & Export, the app automatically partitions the selected examples into two files: a training set (the bulk of the examples) and a validation set (approximately 10%), used to measure the model during training.

The Automated Trainer takes both of these splits, verifies that they are non-empty and match the required ChatML format, and runs the training pipeline once you approve and submit the fine-tune job. The validator is what makes the training run measurable: it holds back examples the model did not train on, so its progress is tested against unseen data.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part One · Define the Project

1. Choose the project mode

Project Definition offers two modes. Select the mode that fits how you want to create the project definition.

AI-Guided

In AI-Guided mode, the AI asks questions and creates the project-definition answers from the user's responses. The user works through the questions, then reviews the resulting definition.

Non-Guided

In Non-Guided mode, the user defines the project directly through the project-definition interface, without the AI-guided question-and-answer process.

2. Set the project details

Use the available Project Definition fields to specify the model and dataset you intend to create. The established definition includes the system prompt, target goal, and constraints or instructions.

  • System Prompt: Describes the model's identity and characteristics, including who it is and how it should respond.
  • Target Goal: Defines what the finished model should be able to do, its purpose, and the kinds of interactions it should handle.
  • Constraints & Instructions: Provides practical guidance for generation, such as preferred response length, wording preferences, stylistic boundaries, or duplicate avoidance.

A clear, specific project definition gives the generation workflow a consistent reference.

3. Select the example type

The example type is chosen during Project Definition, not in the Batch Registry.

  • In AI-Guided mode, the system automatically chooses Instruction or Chat/Multi-Turn.
  • In Non-Guided mode, the user selects the applicable type during Project Definition.

This choice is part of project setup and does not need to be selected again in the Batch Registry.

4. Lock the project definition

When the project definition is ready, lock it to proceed with that project. A locked project definition cannot be unlocked. If the user needs a different definition, the user must start a new project.

Locking keeps the project definition consistent across the batches created under it. Review the definition before locking because it cannot be reopened for edits.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Two · Batch Synthesizer and Data Creation

What a batch is

A batch is a group of examples created around a skill, subject, or purpose. Working in batches makes it possible to review a focused set of examples at a time, check coverage, and make a separate approval decision for each group.

AI-Guided batch generation

AI-Guided batch generation begins with the user's list of skills and returns prepared batch suggestions.

  1. The AI asks the user for a list of skills the project should cover.
  2. The AI generates 20 suggested batches from the skill list.
  3. The user returns to the application UI. The 20 generated batch examples are waiting there, complete and ready to be copied.
  4. Click the copy button once to place a selected suggestion into the Batch Synthesizer.
  5. Generate and approve the selected batch. Batches must be generated and approved one at a time.

Choose the batches you want

The 20 suggestions are optional. The user may leave out suggestions that do not fit the project and may define and generate additional batches as desired. The user determines which batches become part of the project dataset.

Non-Guided batch generation

In Non-Guided mode, the user defines and generates batches directly in the application. The user chooses the batch topics and decides which batches to create.

Building coverage across the corpus

The corpus is the collection of approved batches assembled for the project. Batches can cover different skills, subjects, and interaction types, allowing the user to see what has been included and where additional examples may be useful.

The corpus may include generated batches, batches created through document conversion, and the optional pre-generated FTK TRiAD alignment corpus. Every batch must be analyzed in QA before it can enter the registry.

Planning coverage and variety

A dataset can contain many examples and still cover only a narrow range of situations. Review the skills list and the batches already in the registry to see which areas have been covered and which still need examples. AI-Guided suggestions can map a starting set of skills, while additional user-defined batches can address gaps.

Consider including varied phrasings, different levels of task difficulty, short and extended interactions, ambiguous requests, and situations that require a carefully tailored response. Avoid relying on one repeated formulation when several natural formulations can demonstrate the same skill.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Three · Convert Documents into SFT Examples

The Document Converter lets users upload documents and convert their contents into SFT examples. Each conversion starts with a choice among three conversion types: Knowledge, Transcript, or Literature.

Knowledge conversion

Choose Knowledge to convert document content into knowledge-oriented SFT examples. The UI includes an instructions field where the user can specify what the conversion generator should do with the source material.

Transcript conversion

Choose Transcript when the uploaded document contains a transcript or conversation with speaker turns. The source document must use identifiable role labels so the converter can interpret which role is speaking.

  • When Transcript is selected, the UI displays a dedicated field for entering the role labels used in the document.
  • Enter the source labels, such as user and assistant, matching the document.
  • Use the instructions field to provide any additional directions for the conversion generator.

The role-label field is specific to Transcript conversion. It is separate from the conversion-instructions field.

Literature conversion

Choose Literature to convert literary material into SFT examples. The instructions field lets the user specify requirements for how the conversion generator should handle the source material.

Conversion instructions

All three conversion types provide a field for specific instructions to the conversion generator. Knowledge, Transcript, and Literature each have this field; Transcript additionally has the role-label field.

Document conversion sequence

  1. Upload the document or documents to be converted.
  2. Select Knowledge, Transcript, or Literature.
  3. If Transcript is selected, enter the role labels used in the source document.
  4. Enter any specific conversion instructions.
  5. Run the conversion to create SFT examples.
  6. Review the resulting batch in QA before adding it to the Data Registry.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Four · Optional FTK TRiAD Alignment Corpus

The pre-generated FTK TRiAD alignment corpus is optional. It can be added with one click by choosing the desired batch size.

Available batch size Action
150 examples Add a pre-generated batch of 150 examples.
300 examples Add a pre-generated batch of 300 examples.
750 examples Add a pre-generated batch of 750 examples.

Choose whether to include the corpus and select the available size that fits the project. The corpus is optional.

TRiAD Alignment imports are separate from generated and converted batches. TRiAD batches are pre-approved on import, and the automated QA run does not audit them.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Five · Quality Assurance

Each generated or converted batch must be analyzed in QA before it can be added to the Dataset Registry. QA is not a guided question-and-answer workflow. It analyzes the batch, flags potentially problematic examples, and provides a clear written explanation for each flag. TRiAD Alignment batches are pre-approved on import and are not audited by the automated QA run.

Open Quality Assurance → AI Guide. Its first question asks whether to run the audit for you or have you run it yourself.

Automated QA

Choose Run the Quality Audit for me for automated QA. The app audits up to four batches concurrently, and progress advances as each batch’s audit finishes. Flagged examples may go through the automated repair process.

Manual QA

Choose I’ll run the quality analysis myself to continue through the manual guide:

  1. Select a batch.
  2. Run Run AI Quality Audit.
  3. Review the score and each flagged example with its written explanation.
  4. Decide whether to regenerate, remove, approve, or reject examples.

A perfect score is not required for approval.

Regenerate Flagged

Click Regenerate Flagged to automatically regenerate flagged examples. The regenerated examples are analyzed again.

Some examples may remain flagged or return to the flagged group if regeneration has not adequately addressed the issue. You can click Regenerate Flagged repeatedly to continue the process, including until the score reaches 100% if desired.

Deduplicate

Click Deduplicate to instantly delete all flagged examples from the batch. Regenerate Flagged attempts to regenerate the examples; Deduplicate deletes the flagged examples.

Approve or reject

After QA analysis, you must approve or reject the batch. Approved batches are added to the Dataset Registry.

You may ignore any flags and approve the batch. A flag may not align with your intention for an example, so you retain the final say on quality. You may approve a batch with flags remaining and do not have to reach a 100% score first.

Once QA is complete, the app offers the option to train a model or export the dataset.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Six · Dataset Registry and Compile & Export

The Dataset Registry is where the user selects which QA-checked batches will make up the final dataset. It is not simply a list of every batch in the project: the user chooses which approved batches to include in the dataset that will be compiled and exported.

Select batches for the final dataset

Each registry entry represents a batch and displays identifying information so the user can recognize what is being included. Depending on the batch, the entry can show its name, batch ID, source, template, number of examples, and QA-checked status. A selection control lets the user include or leave out each batch.

  • Review the batch name and source to identify the content, such as Document Conversion.
  • Check the template shown for the batch, such as an Instruction Template.
  • Review the example count and confirm that the batch is marked QA Checked.
  • Select the batches you want in the final dataset. Only the selected batches are included in the compile-and-export operation.

Review the selected dataset breakdown

The Selected Dataset Breakdown summarizes the current selection before export. It reports how many batches are included and the total number of selected SFT examples. It also shows the automatic partition into training and validation sets.

The application partitions approximately 10% of the selected examples for validation and assigns the remainder to the training set. For example, a selection of 115 examples may be divided into 103 training examples and 12 validation examples. The displayed counts are the actual counts for that selection.

Choose the target export template

Target Export Template Format controls the format applied to the selected dataset for export. Choose the template that matches the format you intend to use. The interface displays the selected format and a description of its structure. For example, a ChatML instruction format uses role markers such as <|im_start|> and <|im_end|> to mark message boundaries.

After choosing the desired template, use the format action to apply that format to the selected batches. The Apply to Batches action applies the selected export template to the batch data. The interface's formatted output preview then shows how the data is represented in the selected format.

Inspect the formatted output preview

The Formatted Dataset Output Preview lets the user inspect the converted structure before exporting. It identifies the active format and provides a preview of the output data. The preview can show both a JSONL representation, where each record occupies a single line, and a pretty-printed JSON representation, where the same structure is displayed across multiple lines for easier reading.

  • Use the preview to confirm that the selected template has been applied and that the output structure looks as intended.
  • Use the copy control to copy the JSON preview when needed.
  • The preview is a representation of the formatted dataset; the export controls below produce the actual training and validation files.

Compile the dataset and export both subsets

Compile & Export gathers the selected batches, applies the selected export format, and prepares separate files for training and validation. The application partitions approximately 10% of the selected examples into the validation subset and uses the remaining examples for the training subset.

Training-set exports

The training section provides controls to export the training set as JSON or JSONL and to copy the training JSONL content to the clipboard. JSON is a structured document containing the records; JSONL stores one JSON record per line.

Validation-set exports

The validation section provides corresponding controls to export the validation subset as JSON or JSONL and to copy the validation JSONL content to the clipboard. Keep the training and validation files distinct because they represent separate subsets of the compiled dataset.

Compile & Export sequence

  1. In the Dataset Registry, select the QA-checked batches to include in the final dataset.
  2. Review the selected batch count and total selected SFT examples.
  3. Review the automatically partitioned training and validation counts.
  4. Choose the Target Export Template Format.
  5. Apply the selected export format to the batches.
  6. Inspect the Formatted Dataset Output Preview.
  7. Export or copy the training set and validation set in the required JSON or JSONL form.

Compile & Export prepares the dataset files for the next stage. It is distinct from Automated Training: this stage selects, formats, partitions, and exports the data; Automated Training uses the resulting training corpus and validator to run the selected model's training pipeline.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Seven · Automated Training

Automated Training follows the Batch Registry. It takes the project's training corpus and validator and runs them through the training pipeline.

Choose a base model

Base model Recommended use
Qwen 3.5 9B Base Recommended overall.
Qwen 3.5 4B Recommended for low-compute local deployment.
Llama 3.1 70B Recommended for hosted deployment and more complex enterprise purposes.

Choose the base model that fits the intended deployment and start the automated workflow. The system automates the training pipeline using the training corpus and validator. When training finishes, the workflow provides a link to the resulting model on Hugging Face.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Eight · Model Access and Repository Options

Public model

The model produced by Automated Training will be public in the TRiAD Ai public Hugging Face repository.

Transfer to the user's Hugging Face account

The user can transfer the resulting model to their own Hugging Face account. This is optional.

Request removal from the TRiAD Ai public repository

The user may optionally request that the public model be deleted from the TRiAD Ai public repository. The requested removal will be completed within 48 hours.

Transferring the model to the user's own account and requesting removal from the TRiAD Ai public repository are separate options.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Part Nine · Craft Notes and Common Pitfalls

Repetition

When the same phrase appears across many examples, the trained model may repeat it even when it does not fit the situation. Review repeated introductions, stock endings, and overly similar examples during QA.

Overfitting and narrow coverage

A small or narrow dataset can encourage memorization rather than broader pattern learning. Variety across skills, phrasings, and situations gives the dataset more coverage. The training workflow includes a validator alongside the corpus.

Skipping review

QA is part of the workflow before registry entry. Review the explanations attached to flags and choose the appropriate action for each batch. The user has the final say: flags can be regenerated, removed through Deduplicate, or left in place when the user decides the batch should be approved.

Changing the project definition

The project definition cannot be unlocked once locked. If a different definition is required, start a new project.

SFT Studio Pro · triadicai.agency · Supervised Fine-Tuning Synthesis Workspace

Quick Reference

Stage Action Key point
Project Definition Choose AI-Guided or Non-Guided; define the project; select the example type. Locked definitions cannot be unlocked; start a new project to change them.
Batch Synthesizer Generate directly or use 20 AI-generated suggestions. Copy and generate batches one at a time; suggestions are optional.
Document Converter Upload documents and choose Knowledge, Transcript, or Literature. Enter instructions for all types and role labels for Transcript.
FTK TRiAD corpus Optionally add a pre-generated batch. Choose 150, 300, or 750 examples.
QA Analyze, review flags, regenerate or deduplicate, then approve or reject. The user retains the final decision.
Batch Registry Collect approved batches. Templates have expanded; example type is set in Project Definition.
Automated Training Train the corpus and validator on a selected base model. Qwen 3.5 9B Base, Qwen 3.5 4B, or Llama 3.1 70B.
Model access Open the Hugging Face model link. Transfer to your account if desired; repository removal is available on request within 48 hours.