Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Full Benchmark Report

The Full Benchmark Report represents the complete output of benchmark execution.

It contains every successfully executed benchmark request together with all measured performance metrics, execution metadata, verification results, benchmark configuration, hardware information, and execution statistics.

Unlike the remaining report formats, the Full Benchmark Report intentionally preserves all benchmark execution details.

This report serves as the authoritative source from which every other benchmark report is generated.

For this reason, the Full Benchmark Report should always be preserved after benchmark execution.

Purpose

The Full Benchmark Report has several primary purposes.

  • Preserve complete benchmark execution.
  • Allow future score recalculation.
  • Enable historical comparison.
  • Support benchmark diagnostics.
  • Provide reproducible benchmark data.

Unlike compact score reports, the Full Benchmark Report contains enough information to regenerate scoring results using future scoring versions.

Report Generation

The report is generated immediately after benchmark execution completes successfully.

Every executed benchmark request contributes one or more benchmark records.

Failed benchmark requests are also recorded together with failure diagnostics.

The report therefore represents the exact execution state of the benchmark.

Report Structure

The report consists of several logical sections.

General Information

Contains benchmark identifiers and execution metadata.

Hardware Snapshot

Describes the hardware configuration used during benchmark execution.

Benchmark Configuration

Contains benchmark parameters supplied during execution.

Category Results

Contains raw execution results for every benchmark category.

Execution Statistics

Contains execution counters and timing information.

Failures

Contains benchmark failures together with diagnostic information.

Together these sections completely describe one benchmark execution.

General Information

The report begins with general benchmark metadata.

Typical information includes:

  • Report identifier
  • User identifier
  • Benchmark version
  • Scoring version
  • Execution timestamp
  • Operating system
  • Architecture
  • Benchmark duration

These values uniquely identify the benchmark execution.

Hardware Snapshot

The complete detected hardware configuration is embedded directly inside the report.

The hardware snapshot contains:

Processor

  • Processor model
  • Physical cores
  • Logical processors

Memory

  • Installed capacity
  • Available memory
  • Memory modules
  • Manufacturer
  • Frequency
  • ECC information

Storage

  • Storage devices
  • Firmware versions
  • Benchmark storage device

Operating System

  • Operating system
  • Architecture
  • Hostname

Hardware Fingerprint

  • Deterministic hardware identifier

Embedding the hardware snapshot directly into the report guarantees long-term reproducibility.

Benchmark Configuration

The report records every benchmark parameter used during execution.

Examples include:

  • Executed benchmark categories
  • Worker configurations
  • Benchmark directory
  • Report identifier
  • User identifier
  • Measured iterations
  • Warmup iterations
  • Compilation environment

Recording benchmark configuration allows historical benchmark executions to be reproduced exactly.

Benchmark Results

The largest section of the report contains raw benchmark execution results.

Every benchmark category records its own execution format.

Examples include:

JSON

  • Throughput
  • Object counts
  • Dataset sizes

Hashing

  • Processed bytes
  • Algorithm
  • Throughput

Encryption

  • Processed bytes
  • Algorithm
  • Verification

Compilation

  • Build duration
  • Compiler
  • Build profile
  • Build verification

Storage

  • Throughput
  • Operations
  • Block sizes
  • Filesystem configuration

Raw benchmark results remain intentionally category-specific.

No normalization is performed inside the Full Benchmark Report.

Verification Results

Every benchmark execution records verification status.

Verification includes:

  • Execution success
  • Validation status
  • Verification failures
  • Diagnostic messages

Only verified benchmark executions participate in score generation.

Failures remain preserved for diagnostic purposes.

Execution Statistics

Execution statistics summarize benchmark progress.

Typical statistics include:

  • Planned requests
  • Executed requests
  • Successful requests
  • Failed requests
  • Planned scenarios
  • Successful scenarios
  • Failed scenarios
  • Total benchmark duration

These values provide a quick overview of benchmark execution quality.

Timing Information

Execution timing is recorded both globally and per benchmark category.

Examples include:

  • Total execution duration
  • JSON benchmark duration
  • Hashing duration
  • Encryption duration
  • Compilation duration
  • Storage duration

Recording execution timing allows benchmark users to identify which benchmark categories dominate overall execution time.

Failure Information

If benchmark execution encounters failures, diagnostic information is preserved.

Typical failure information includes:

  • Benchmark category
  • Scenario
  • Request parameters
  • Failure reason
  • Verification status
  • Execution directory

Failures never prevent successful benchmark results from being preserved.

Instead, they become part of the benchmark history for later investigation.

Relationship to Other Reports

The Full Benchmark Report acts as the source for every remaining benchmark report.

            Full Benchmark Report
                     │
                     ├────────► Scoring Report
                     │
                     ├────────► Global Score Report
                     │
                     └────────► Benchmark Comparison

No additional benchmark execution is required to generate these reports.

Every subsequent report is derived exclusively from the Full Benchmark Report.

Long-Term Compatibility

The Full Benchmark Report has been designed for long-term compatibility.

Future benchmark releases may introduce:

  • Additional benchmark categories
  • Additional workload parameters
  • New scoring versions
  • New diagnostics

Historical reports remain valid because benchmark execution data is preserved independently from score calculation.

This design allows benchmark scores to be recalculated in the future without repeating benchmark execution.

Design Summary

The Full Benchmark Report represents the complete historical record of one benchmark execution.

It preserves benchmark configuration, hardware information, execution results, diagnostics, verification status, timing information, and execution statistics in a deterministic and versioned format.

Because every remaining benchmark report is derived from this document, the Full Benchmark Report serves as the authoritative source of benchmark information and should always be preserved for future analysis, comparison, and score recalculation.

Scalionix Docs

Keyboard Shortcuts

Navigate the documentation without leaving the keyboard.
Navigation
Previous subject
←
Next subject
→
Previous subsection
Alt + ↑
Next subsection
Alt + ↓
Interface
Documentation Home
Ctrl + Enter
Search
Alt + Q
Open shortcuts
?
Close dialog
Esc
Scalionix Docs

Search Documentation