pip offline download

pip download -r requirements.txt --no-binary :all: -d /path/to/download/dir

Qwen/Qwen3-0.6B model download

HF CLI 설치 (처음 한 번만)

pip install huggingface_hub

로그인 (오프라인 사용 전 한 번만 필요)

huggingface-cli login # 토큰 입력 (https://huggingface.co/settings/tokens)

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

모델 로컬 저장

huggingface-cli download Qwen/Qwen3-0.6B --local-dir ./models/Qwen3-0.6B --local-dir-use-symlinks False

sentence-transformers model download (chroma vector db)

from sentence_transformers import SentenceTransformer

model = SentenceTransformer('all-MiniLM-L6-v2')

model.save('./models/all-MiniLM-L6-v2')

실행방법

uvicorn manual:app --host 0.0.0.0 --port 8040 --reload