Context-preserving sparse data representation

Researcher:
Prof. Avi Mendelson | Electrical and Computer Engineering

Technology Overview

This technology introduces Context-Preserving Sparse Data Representation Encoding and Decoding (CPSE/D) – a breakthrough approach for representing complex hierarchical or compositional information using sparse distributed representations (SDRs). Inspired by principles observed in the neocortex, this method enables machines to encode and decode structured information with unprecedented efficiency and transparency.

Traditional SDR encoding techniques often suffer from high dimensionality, blurred component similarity, high compute cost, and an inability to recover component order. CPSE solves these limitations by preserving similarity, maintaining sparsity, and efficiently capturing both structure and order within a compact binary vector. The companion decoding method CPSD reliably retrieves both the identity and order of encoded components, even when dealing with deeply nested or large compositional structures.

Together, CPSE and CPSD form a highly efficient computational framework for applications that require fast, scalable, and interpretable representation of structured knowledge – especially in robotics, neuromorphic systems, embedded AI, and real-time decision-making platforms.

 

Advantages

  • Runtime Efficiency: The encoding converges in only a few iterations regardless of structure size, enabling near-constant runtime.
  • Energy & Memory Efficiency: Fully utilize the SDR sparsity, drastically reducing power consumption and memory footprint compared to dense vector methods.
  • High Decoding Accuracy: Preserves enough component information to reliably decode both identity and order with extremely low false-positive rates.
  • Encoded vectors enable context-aware similarity detection.
  • Order Recovery: CPSE embeds sequence information directly into the representation, and CPSD deterministically recovers composition order.
  • Improved AI Reasoning: The technology enables transparent, traceable reasoning by allowing direct inspection and step-wise reconstruction of encoded decisions.
  • Noise Robustness: Sparse binary properties ensure stable decoding even when the composite vector is partially noisy or incomplete.
  • Compositional Generalization: The method enables AI systems to reason over novel combinations of known components without retraining.
  • Semantic Similarity Awareness: Similar components yield similar encodings, supporting analogy-based reasoning.

 

Applications

  • Robotics: Enables efficient encoding of action sequences and object structures for real-time motion planning and decision-making.
  • Autonomous Systems: Supports fast, interpretable reasoning for navigation, control, and multi-sensor fusion.
  • Neuromorphic Computing: Provides a sparse, binary computation model ideal for brain-inspired, low-power hardware.
  • Edge AI & IoT: Allows complex state representation on devices with limited compute and memory resources.
  • Natural Language Processing: Efficiently encodes sentences, grammar structures, and semantic compositions for robust retrieval.
  • Knowledge Graphs & Cognitive Architectures: Offers transparent, structure-preserving representations for symbolic reasoning.
  • Biosignal Classification: Enhances hyperdimensional methods used in ECG/EEG analysis through stable, compositional representations.
  • Explainable AI: Enables deterministic reconstruction of decision structures for model transparency.
  • Hierarchical Data Modeling: Supports efficient encoding of multi-level structures such as programs, workflows, and scene descriptions.
arrow Business Development Contacts
Dr. Arkadiy Morgenshtein
Director of Business Development, ICT
our new tracks