ID Optima

IDENIFE’s first fully automated high-quality dataset factory

AI Ready.Metrics, generated.

Turn existing material and governed assets into datasets for AI, as well as business metrics and data marts. Powered by ID Axis, Optima connects requirements, processing, validation and version delivery in one production flow.

Connect existing data

Documents · Records · Governed assets

Understand and process

Parse · Clean · Map · Validate

High-quality dataset production
AI ReadyRAG corpora · Training samples
MetricsDefinitions · Data marts

Data, definitions and quality evidence, together.

Usable structureTraceable sourcesVerified quality
From data assets to usable outputs · Process illustration

AI Ready · Data processing for models

From existing materialto datasets ready for AI.

Prepare data for RAG retrieval and model fine-tuning: parse, deduplicate, mask and structure content, retain provenance and access rules, then validate it against agreed criteria. Deliver the content, structure and evidence that the intended AI workflow requires.

  1. Ingest & parse

    Identify content and source structure

  2. Clean & protect

    Deduplicate and mask sensitive content

  3. Shape for use

    Create chunks or training samples

  4. Validate

    Check structure, citations and access

  5. Deliver

    Datasets, metadata and acceptance reports

Two uses. Two processing paths.

Turn whole documents into knowledge with a source.

Retrieval needs complete semantic passages, together with provenance and access rules. Optima preserves the content and its conditions of use in the same dataset.

Process illustration · sample material

Source material

Product material · PDF

Equipment handbook
Service requests

Record the equipment model, fault message and time of occurrence, and submit the details to the service team.

Routine maintenance

Disconnect power and confirm the equipment has stopped. Record inspection items and abnormalities after maintenance.

One document contains different topics and sections.

Optima processing

  1. Identify structure

    Parse headings, sections and body text to organize useful content.

  2. Split by meaning

    Keep a complete topic in each passage to retain context.

  3. Retain the evidence

    Link source locations and access rules; check duplicates and sensitive content.

Delivered data

Knowledge passage 1
Service requests

Record the equipment model, fault message and time of occurrence, and submit the details to the service team.

Source · Handbook · Service · p.12
Knowledge passage 2
Routine maintenance

Disconnect power and confirm the equipment has stopped. Record inspection items and abnormalities after maintenance.

Source · Handbook · Maintenance · p.18

Access rules travel with each passage

For knowledge bases: content to retrieve, evidence to cite.

Passage sets, provenance and access metadata, and a retrieval acceptance report.

Metric generation · Data processing for business

From a business reportto metrics you can deliver.

Identify metrics and dimensions from requirements or report templates, interpret their context and map them to existing assets. Generate metric definitions, transformation SQL and data marts for downstream analytics and reporting systems.

From a report template to a data definitionInteractive illustration · sample assets

Monthly operating report

Select a metric to inspect its definition.

Sample report template. Values are intentionally blank; select a metric to inspect its mapping.
MetricThis monthLast month
——
——
DimensionsMonth / Region

The template defines what data is needed. Figures are not report results.

Metric definition

Monthly sales

Source asset
Sales orders · orders
Aggregation
SUM(order_amount)
Time definition
Order date, grouped by calendar month
Mapping basis

The template calls for monthly sales. Map the sales amount and order date to produce a monthly aggregation from the governed order asset.

Production outputsMetric & field definitionsTransformation SQLData mart

Interpret the requirement

Use metric names, row and column context, and time conditions to form requirements that people can review.

Map assets and generate processing

Connect source fields, aggregations and dimensions, translating the metric requirement into processing logic.

Keep business decisions visible

People confirm refund timing or consolidation rules. Production branches that do not depend on those decisions can continue.

For data governance delivery teams

Turn governed assetsinto deliverable data products.

Extend existing governance work with AI-ready corpora, training samples and metric datasets. Give teams more room to focus on business definitions and delivery quality, with less repetitive mapping, transformation development and acceptance documentation.

Extend delivery into AI

Build retrieval corpora and training data on existing assets to support knowledge bases, fine-tuning and AI applications.

Reduce repeated development

Connect requirements, field mapping and SQL generation in one flow, reducing manual translation and handoffs between stages.

Reduce waiting and handover work

Isolate decisions that need confirmation while independent branches continue. Collect production records and acceptance evidence with each version.

From configured tasks to production goals.

From configured tasks to production goals.
AspectCommon metric workflowsOptima dataset production
Starting pointDelivery teams translate business requirements into metric models, calculation rules and field relationships, then configure tasks.Interpret goals from requirements or templates and propose metrics and mappings for business confirmation.
ExecutionExecute configured tasks through SQL, visual pipelines and scheduling.ID Axis decomposes goals and coordinates tools, connecting mapping, generated processing and validation.
Delivery scopeFocus on metric models, computed results and query services, supported by quality controls.Produce AI corpora, training samples and metric datasets, with metadata, processing logic and acceptance evidence.

Compared with common configuration-driven delivery workflows. Efficiency comes from fewer repeated configurations, handoffs and waits; actual gains depend on source quality, business complexity and acceptance criteria.

Technology foundation

One reasoning framework.A complete production flow.

Purpose, intended users, output formats and acceptance criteria form a target contract. The confirmed agreement guides production and the checks on the final output.

ID Axis.

IDENIFE’s in-house multi-agent reasoning framework.

ID Axis breaks data production goals into coordinated responsibilities, connecting model reasoning, tool calls and execution feedback. Optima applies this framework from requirements to deliverable datasets.

HuanYu · Understanding and reasoningTools · Parsing, processing and checks

Understand the goal and plan the work

HuanYu provides semantic understanding and analytical reasoning to identify the structure, context and acceptance requirements of retrieval corpora, training samples and metric datasets.

Coordinate work and invoke tools

ID Axis orchestrates parsing, mapping, transformation and validation tasks, invokes the appropriate tools and uses execution feedback to progress production.

Manage dependencies and retain decisions

Ambiguous definitions and mappings are raised for confirmation while independent branches continue. Decisions, production records and version outputs stay in the same project.

Quality and version delivery

Meet the standard.Then deliver.

High quality is checked against explicit rules. A version stays pending while blocking rules remain unmet and proceeds to release and delivery once the requirements are satisfied.

Define quality for the intended use

Check citations and access for retrieval, structure and masking for training, and fields, calculations and definitions for metrics. Each rule has an explicit result.

Deliver data and its evidence

A candidate version brings data, metadata and acceptance reports together. Offline packages preserve a snapshot from creation; later updates produce a new package.

Illustration · knowledge retrieval dataset

Evidence travels with the data.

  1. Structure & traceability

    Passages stay linked to their source.

    Check each passage for its content, source document and section reference, with the required field types.

  2. Access permissions

    The delivery audience needs confirmation.

    The source is restricted to the service team. A broader delivery audience requires permission to be confirmed first.

  3. Sensitive information

    Keep a record of how data was handled.

    Apply the agreed masking rules to personal details, retaining the affected fields and processing results for review.

Unresolved issues stay visible.Blocking checks prevent release until the corresponding issue is resolved and validated again.

ID Optima

From data governance to data production.

Start with assets built in Omnia or existing material. Optima produces AI-ready datasets and business metrics that take your data into new applications.

Discuss OptimaExplore ID OmniaBack to AI Ready
鲁ICP备2024109755号-2
Drag to move. Right-click, touch and hold, or press Shift+F10 to choose a corner.