Livoa LogoLivoa
EXTERNAL


SOURCES

Hugging


Face Hub

HF Datasets


(e.g., Wikitext)

User


Command /

Prompts

STAGE 1:


MODEL

PREPARATION

UniversalModelLoader.load
Detect Model Type


& Config

Load HF


model

Instantiate


Custom

Traceable

Architecture

Copy Weights
Ready PyTorch


Traceable Model

STAGE 2:


IR GENERATION &

OPTIMIZATION

IRGenerator.generate
torch.jit.trace
ov.convert_model
Ia Model Size


Exceeds the

NPU storage?

NNCF INT8


Quantization

ov.save_model
OpenVINO


IR Files

(.xml & .bin)

STAGE 3:


NPU RUNTIME

INITIALIZATION

NPURuntime.initialize
core.read_model
INTEL NPU HARDWARE

image-2

by Sat

0
0 uses