inference

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

💎1MB lightweight face detection model (1MB轻量级人脸检测模型)

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Runtime type system for IO decoding/encoding

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

An easy to use PyTorch to TensorRT converter

OpenVINO™ Toolkit repository

TypeDB: a strongly-typed database

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

LightSeq: A High Performance Library for Sequence Processing and Generation

TensorFlow template application for deep learning

Acceleration package for neural networks on multi-core CPUs

DELTA is a deep learning based natural language and speech processing platform.

Deploy a ML inference service on a budget in less than 10 lines of code.

High-efficiency floating-point neural network inference operators for mobile, server, and Web

Pytorch-Named-Entity-Recognition-with-BERT

Package for causal inference in graphs and in the pairwise settings. Tools for graph structure recovery and dependencies are included.

Bolt is a deep learning library with high performance and heterogeneous flexibility.

TensorFlow models accelerated with NVIDIA TensorRT

Efficient, scalable and enterprise-grade CPU/GPU inference server for Hugging Face transformer models 🚀

Embedded and mobile deep learning research resources