I've been putting together a new course for Trust Insights, AI for Writing (and Writers), which will be coming out August 25th, and during the process of creating that course, I realized I've never walked through setting up a discount agentic AI system.

For a while now, many of us who work in "corporate" have had access to what feels like unlimited amounts of AI (though that free ride is coming to an end at enterprise shops thanks to absurdly large bills). For the average person who doesn't have the backing of a corporation, how could we tap into the power of agentic systems without tapping out our wallets?

This tracks back to a question from Leslie in the Analytics for Marketers Slack group:

"have you done a video or post with recommendations for a cheap second computer set up someone can use to build their separate AI machine?"

So this week, let's get scrappy.

Warnings, Disclaimers, Disclosures

If you work at a company, please check with IT before installing software willy-nilly. As a former IT professional, we thank you.

Second, in this issue I'll be talking about Chinese-made AI models like Qwen and DeepSeek. There is a HUGE difference between a Chinese model hosted by a company in the People's Republic of China (PRC), and a Chinese-made model hosted by a company outside the PRC.

It is manifestly unsafe to use any AI models hosted in the PRC for any kind of confidential information, period. Totally fine to use those models for things that are completely public, like research requests.

However, it is completely safe to use Chinese-made AI models on your own hardware, or in an infrastructure that's trustworthy. There are many, many great inference providers that have things like Zero Data Retention (ZDR) hosting which are even safer to use than Big Tech models because the providers warrant that they don't keep your data at all. (Most Big Tech providers have a "we hold onto your data for 30 days to prevent abuse" clause in their Terms of Service)

There is a lot of fear mongering about open weights models (including the Chinese ones) happening right now because Big Tech providers' profits are on the line if these models continue to offer parity of capabilities at a fraction of the cost. Don't believe the hype; open weights models are so safe that companies like HuggingFace have used them to do their own cybersecurity defenses.

Third, where I have commercial relationships, I'll disclose them. I have an Amazon affiliate link in this week's article, and obviously I work for my company, Trust Insights. I do not have a financial interest in the other companies mentioned as of the time of writing. (but I'm happy to, call me)