Livoa LogoLivoa
Data Collection


(IU X-rays, Reports)

Preprocessing


(Resizing, Clean, Tensor Conversion)

BLIP-2 Framework


➢ Image Encoder (VIT)

➢ Q-Former (BLIP-2)

➢ LLM Decoder (GPT-2)

Fine-Tuning (QLoRA)


➢ 4-bit Quantization

➢ Adapter layers for LLM (LoRA)

Training & Validation


➢ AdamW Optimizer

➢ Evaluation Metrics :

(BLEU, ROUGH, METEOR, BERT Score, ROUGH-L, CIDr)

score
Model Generated Reports


➢ Compare with Expert Report

score
Deployment


➢ Clinical Workflow

➢ Radiologist Use

diagram

by ak

0
0 uses