(IU X-rays, Reports)
(Resizing, Clean, Tensor Conversion)
➢ Image Encoder (VIT)
➢ Q-Former (BLIP-2)
➢ LLM Decoder (GPT-2)
➢ 4-bit Quantization
➢ Adapter layers for LLM (LoRA)
Training & Validation
➢ AdamW Optimizer
➢ Evaluation Metrics :
(BLEU, ROUGH, METEOR, BERT Score, ROUGH-L, CIDr)
➢ Compare with Expert Report
➢ Clinical Workflow
➢ Radiologist Use
by ak