DON27TZ02-NV002 — Field-Friendly Super Intelligence and Machine Learning Systems

Develop an Super Intelligence/Machine Learning (SI/ML) method that achieves the high-performance accuracy of modern Deep Neural Networks (DNNs) while mitigating their limitations.

Current DNN architectures suffer from inherent "Black Box" vulnerabilities, demanding massive computational scaling and offering no clear link between parameter count and performance. The proposed model must address these shortfalls: - Optimized Resource Utilization: Unlike DNNs that heuristically overparameterize to boost accuracy, the proposed model must quantitatively map parameter count to expected performance and enable users to identify the minimum configuration required for mission success, significantly reducing computational overhead, complexity, and deployment costs. - Transparency: The model must replace opaque, distributed neural layers with novel methods for interpretability and trust that go beyond the current post-hoc techniques. By making input-output logic similar to standard programming code, the model should ensure decisions are easily explainable, verifiable, and compliant with auditing standards. - Reliability: The model must recognize whether it can provide a reliable output for a given problem instance, which will address another well-known criticism of DNNs wherein performance is typically measured as an average, e.g., average accuracy, over many instances of a problem and will help build user trust and acceptability of the model vs DNNs, particularly in sensitive areas like person identification in a crowd video and identifying the source of a cyber-security violation.   The model must deliver DNN-level performance with superior speed and a reduced memory footprint, optimized for lean, secure processing on low-cost CPU and embedded edge hardware. By eliminating cloud-dependence, the model will maximize data privacy and operational security while substantially reducing power consumption compared to GPU-reliant models. It must operate flexibly across mixed CPU-GPU environments, allowing operators to dynamically balance throughput against computational cost. Beyond standard convolutional neural networks (CNNs), the model’s architecture must be extensible to transformer-based and multimodal models handling text, image, and video.   The metrics below establish outer-edge targets specifically for CNN-based image classification. While satisfying every metric is not mandatory, the model will be evaluated on the number of targets achieved and the viability of the engineering trade-offs. Comparison with Base Architecture of ResNet-18 and larger Comparison of the Number of Classes 10 and 100 using 3 datasets: MNIST, CIFAR-10 and CIFAR-100, having different combinations of numbers of classes and total number of image pixels (number of channels*number of pixels per image) Mean Average Accuracy of Classification: Same as DNNs or higher Number of Parameters (Fraction of Base Architecture): 50% of DNNs or less Training MFLOPs/Image (Fraction of Base Architecture): 50% of DNNs or less 6. Training Memory Size (Fraction of Base Architecture): 50% of DNNs or less7. Inference MFLOPs/Image: 50% of DNNs or less8. Rate of Growth of Metrics (5), (6), and (7): Sublinear   In Phase II, similar metrics and their extensibility and relevance to transformers and multimodality scenarios (images and videos as well as their combinations with text to form LLMs and VLMs) will need to be provided and their implementation explained.   This STTR topic requires combinations of research and development, and proposers must demonstrate a strong partnership between the small business and a research institution.   The proposed solution should eliminate the dependency on complex computing infrastructure (e.g., GPUs) by delivering comparable performance on standard off-the-shelf hardware (CPUs, edge devices). It should optimize the cost-to-performance ratio, balancing accuracy with reductions in time, storage, and computational cost. Furthermore, the architecture should ensure robust explainability—like conventional software programs—and provide reliable confidence metrics to establish user trust. At a minimum, the method should result in the development of an alternative to existing CNN-based architectures for image classification.   The many problems with the modern SI/ML architectures and models mentioned earlier are well recognized and reported. Many researchers and companies are currently attempting to address these shortcomings, including a number of startups. Most of the better-known ones are doing so by modifying hardware and software of the industry-leading NVidia systems. None seems to be rethinking the basic formulation of the problem which underlies the direction taken in the approach of the Model. If successful, the Model may turn out to have a major impact on the Naval systems and SI/ML industry which is already very large and growing fast. The deeper impact that could result from the lean design of Model could significantly add to the societal reach of SI/ML methods.

Develop a minimal complexity design to assess the value of the concept of the model. (Note: The design does not have to be optimal but should serve as a feasibility to assess the art-of-the-possible, by conducting an adequate, convincing subset of experiments of those specified in the Description.) Conduct a feasibility study that should investigate all known options that meet or exceed the minimum performance parameters suggested in the Description and should also address the trade-offs and risks, in accordance with the level of innovation. Prioritize demonstrating feasibility on the core image classification challenge even though the long-term vision for the model is extensibility. Prepare a final Phase I report on the design and experimental results and a Phase II plan.

Develop a minimal complexity model prototype and test it with at least all the experiments listed in the Description, ensuring that the results should clearly assess the absolute and relative (to DNN) performances of the scaled operational optimal prototype, and its scalability with increasing data complexity via the specified metrics, to demonstrate the model’s capabilities from the Phase I study determined to be most feasible. Provide the optimal model prototype; a report containing designs and testing results and how they demonstrate the power and future potential of the prototype; and a Phase III plan for prototype evaluation and other potential efforts as necessary. Provide metrics and their extensibility and relevance to transformers and multimodality scenarios (images and videos as well as their combinations with text to form LLMs and VLMs) and their implementation explained. Prepare a Phase III commercialization/transition plan.

Generalize the CNN-targeted prototype model so it also applies to Transformers. Convert the prototype to an industry-friendly replicable form, implementable in one or multiple more progressive versions, as advised by industrial experts. Evaluate it on industry-grade large datasets of large images from very large numbers of classes. Deliver the final model prototype and a report containing designs and testing data. (Note: Detailed mission descriptions and effectiveness requirements will be addressed at a higher level of classification.) Light-weight visual classification systems have many applications, particularly for autonomous robots.