inference

ncnn is a high-performance neural network inference framework optimized for the mobile platform

💎1MB lightweight face detection model (1MB轻量级人脸检测模型)

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Runtime type system for IO decoding/encoding

TypeDB: a strongly-typed database

An easy to use PyTorch to TensorRT converter

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

OpenVINO™ Toolkit repository

TensorFlow template application for deep learning

Acceleration package for neural networks on multi-core CPUs

DELTA is a deep learning based natural language and speech processing platform.

LightSeq: A High Performance Library for Sequence Processing and Generation

🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

Deploy a ML inference service on a budget in less than 10 lines of code.

Pytorch-Named-Entity-Recognition-with-BERT

High-efficiency floating-point neural network inference operators for mobile, server, and Web

Lua Language Server coded by Lua

TensorFlow models accelerated with NVIDIA TensorRT

Bolt is a deep learning library with high performance and heterogeneous flexibility.

Embedded and mobile deep learning research resources

Package for causal inference in graphs and in the pairwise settings. Tools for graph structure recovery and dependencies are included.

Shape and dimension inference (Keras-like) for PyTorch layers and neural networks