Project256

I recently built a large language model chat interface, but traditional request methods only transfer data to the frontend after the model completes its entire output, causing users to think the in... Continue reading...

“What on earth did you design?”, “No merchant is ever going to use this!”, “Merchants don’t think they have a problem in the first place!”, “Go ahead, explain your design thinking!”, “I don’t care ... Continue reading...

I’ve used Java for five years and learned a lot of fancy tricks, but I never seemed to have delved into manual troubleshooting techniques. Recently, I happened to read a book titled Server-Side Dev... Continue reading...

Today, I braved the freezing cold to read at a cafe. Only these weekend trips to a cafe can redeem an otherwise “slacker” weekend of leisure. After all, there are no beds in a cafe, and without ope... Continue reading...

TopicWishing everyone a happy Mid-Autumn Festival & National Day holiday~ Since training large models takes too long—plus spending a ton of money and having a mental breakdown over it—I’m just ... Continue reading...

Handling Banned WordsDuring testing, it was found that “…” frequently appeared in conversations. Analysis showed that there were at least 2K similar responses in the script. Although such responses... Continue reading...

BackgroundRecently, the server was unable to access HuggingFace, and since I wanted to take advantage of free perks, I deployed command-line SSR on the server. However, even though everything was c... Continue reading...

Preparing for Fine-TuningPicking up where we left off, the CLANNAD script has been parsed and processed into a JSON file suitable for fine-tuning LLaMA, so next we’ll dive into the actual hands-on ... Continue reading...

Preparing Fine-Tuning DataToday I plan to achieve the following goals: Read files Gather data statistics Clean data Construct fine-tuning JSON Attempt fine-tuning the LLaMA LLM The code and execu... Continue reading...

Today’s WorkRead a paper translated by an expert: [Paper] LLaMA 2: Open Foundation and Fine-Tuned Chat Models This Ctrip expert provided both Chinese and English, and translated a bunch of LLM-rela... Continue reading...