Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Global Score Report

The Global Score Report is the public representation of a benchmark execution.

Unlike the Full Benchmark Report and the Scoring Report, which contain extensive execution details, the Global Score Report intentionally contains only the information required for benchmark comparison, historical tracking, and future submission to the Scalionix Global Ranking Service.

Its primary purpose is to provide a compact, deterministic, and versioned description of benchmark performance while remaining independent from benchmark implementation details.

The Global Score Report is expected to become the standard exchange format for benchmark results.

Purpose

The Global Score Report has several primary objectives.

  • Represent benchmark performance using a compact format.
  • Enable public benchmark comparison.
  • Support historical benchmark tracking.
  • Serve as the upload format for the Global Ranking Service.
  • Preserve benchmark compatibility across future scoring versions.

Unlike the Full Benchmark Report, this report intentionally excludes raw benchmark measurements.

Design Philosophy

The report has been designed with portability as the primary objective.

A benchmark result should be easily transferable between users without requiring gigabytes of benchmark history.

Consequently, the Global Score Report contains only normalized benchmark information.

The report should remain sufficiently small to:

  • Attach to issue reports
  • Publish on GitHub
  • Store inside version control
  • Upload to online ranking services
  • Archive for long-term historical comparison

Compactness and long-term compatibility were considered fundamental design requirements.

Report Structure

The report consists of several logical sections.

Benchmark Identity

Identifies the benchmark execution.

Benchmark Summary

Provides execution statistics.

Hardware Summary

Describes the benchmarked machine.

Compute Score

Overall computational performance.

Storage Score

Overall storage subsystem performance.

Category Scores

Normalized benchmark category scores.

Scoring Metadata

Contains scoring version and compatibility information.

Each section has been intentionally kept compact while preserving enough information for meaningful benchmark comparison.

Benchmark Identity

Every report contains benchmark identity information.

Typical fields include:

  • Report identifier
  • User identifier
  • Benchmark version
  • Scoring version
  • Execution timestamp

These values uniquely identify one benchmark execution.

Hardware Summary

Rather than storing the complete hardware snapshot, the Global Score Report stores only the information required for hardware identification.

Typical information includes:

Processor

  • Processor model
  • Physical core count
  • Logical processor count

Memory

  • Installed capacity

Storage

  • Benchmark storage device

Operating System

  • Operating system
  • Architecture

Hardware Fingerprint

  • Deterministic hardware identifier

This compact summary allows future ranking services to group comparable systems while minimizing report size.

Benchmark Summary

The report contains a concise summary of benchmark execution.

Typical information includes:

  • Executed benchmark count
  • Successful scenarios
  • Failed scenarios
  • Total benchmark duration
  • Benchmark completion status

This allows ranking services to validate benchmark completeness before accepting uploaded scores.

Compute Score

The Compute Score represents the aggregated computational capability of the evaluated system.

It is calculated exclusively from compute-oriented benchmark categories.

Current contributors include:

  • JSON
  • Hashing
  • Encryption
  • Compression
  • Collections
  • Concurrency
  • Compilation

The Compute Score intentionally excludes every Storage workload.

Storage Score

The Storage Score represents the practical performance of the storage subsystem.

It includes:

  • Sequential I/O
  • Random I/O
  • Metadata
  • Small Files
  • Synchronization
  • Directory Traversal

Storage Score is intentionally reported independently from Compute Score.

This separation preserves meaningful comparisons across future processor generations while accurately representing storage performance.

Category Scores

Every benchmark category contributes an independent normalized score.

Typical category entries include:

  • JSON
  • Hashing
  • Encryption
  • Compression
  • Collections
  • Concurrency
  • Compilation
  • Storage

Publishing category scores allows users to compare specific workload domains rather than relying exclusively on a single overall score.

Scoring Metadata

The report records all information required for score compatibility.

This includes:

  • Scoring version
  • Benchmark version
  • Category count
  • Reference compatibility

Scoring metadata allows future ranking services to reject incompatible benchmark reports while preserving historical benchmark archives.

Intended Usage

The Global Score Report is intended for:

  • Public benchmark sharing
  • Hardware comparison
  • Historical performance tracking
  • Online benchmark ranking
  • Workstation validation
  • Continuous integration performance monitoring

It intentionally excludes benchmark implementation details that are unnecessary for public comparison.

Relationship to Other Reports

The Global Score Report represents the final stage of benchmark processing.

The report hierarchy is illustrated below.

      Full Benchmark Report
                │
                ▼
         Scoring Report
                │
                ▼
       Global Score Report
                │
                ▼
   Global Ranking Submission

Unlike previous reports, the Global Score Report is specifically designed for external distribution.

Public Ranking Compatibility

The report has been designed specifically for future integration with the Scalionix Global Ranking Service.

Expected server-side operations include:

  • Report validation
  • Scoring version verification
  • Hardware classification
  • Duplicate detection
  • Public leaderboard generation
  • Historical benchmark storage

Because the report is deterministic and versioned, ranking services may reliably compare benchmark results generated years apart while preserving compatibility.

Long-Term Stability

The Global Score Report is expected to remain stable across benchmark releases.

Future benchmark versions may introduce:

  • Additional benchmark categories
  • Revised reference values
  • New scoring versions
  • Extended hardware summaries

Existing reports remain valid because every benchmark execution explicitly records its scoring version.

This guarantees that historical benchmark results never become ambiguous.

Design Summary

The Global Score Report represents the canonical public benchmark format produced by the Scalionix System Benchmark.

It combines compactness, deterministic scoring, hardware identification, benchmark metadata, and long-term compatibility into a single portable document suitable for public sharing, historical tracking, and future submission to the Scalionix Global Ranking Service.

Unlike the Full Benchmark Report and the Scoring Report, the Global Score Report intentionally contains only the information necessary for meaningful benchmark comparison, making it the preferred format for benchmark exchange between users and automated systems.

Scalionix Docs

Keyboard Shortcuts

Navigate the documentation without leaving the keyboard.
Navigation
Previous subject
←
Next subject
→
Previous subsection
Alt + ↑
Next subsection
Alt + ↓
Interface
Documentation Home
Ctrl + Enter
Search
Alt + Q
Open shortcuts
?
Close dialog
Esc
Scalionix Docs

Search Documentation