[{"data":1,"prerenderedAt":12},["ShallowReactive",2],{"stack-tr-en-openvino":3},{"tagline":4,"description":5,"strengths":6,"useCase":11},"Intel's toolkit that accelerates inference on CPUs, integrated GPUs and NPUs.","OpenVINO converts a PyTorch, ONNX, TensorFlow or TFLite model into its intermediate representation (IR) and runs it through hardware plugins: Xeon and Core CPUs, integrated or Arc GPUs, the NPU in Core Ultra chips, with AUTO and HETERO modes to spread the load. Its NNCF compression framework quantizes to INT8 or compresses weights to INT4, OpenVINO Model Server exposes models over gRPC\u002FREST, and OpenVINO GenAI serves LLMs locally. It's our choice when inference has to run on Intel PCs, industrial mini-PCs or servers without a dedicated GPU.",[7,8,9,10],"One plugin per Intel target: CPU, integrated GPU, Arc or the Core Ultra NPU.","Direct conversion from PyTorch, ONNX, TensorFlow and TFLite to the IR format.","NNCF: INT8 quantization and INT4 weight compression, LLMs included.","Open source (Apache 2.0), gRPC\u002FREST Model Server and OpenVINO GenAI for local LLMs.","Industrial vision on mini-PCs, smart checkout or kiosks, local LLM assistants on workstations.",1792851797196]