Coder Radio Discord
The Mad Botter Data Platform
Mike's Blog

Alice Promo

1. AI on Red Hat Enterprise Linux (RHEL)

Trust and Stability: RHEL provides the mission-critical foundation needed for workloads where security and reliability cannot be compromised.

Predictive vs. Generative: Acknowledging the hype of GenAI while maintaining support for traditional machine learning algorithms.

Determinism: The challenge of bringing consistency and security to emerging AI technologies in production environments.

1. Rama-Llama & Containerization

Developer Simplicity: Rama-Llama helps developers run local LLMs easily without being "locked in" to specific engines; it supports Podman, Docker, and various inference engines like Llama.cpp and Whisper.cpp.

Production Path: The tool is designed to "fade away" after helping package the model and stack into a container that can be deployed directly to Kubernetes.

Behind the Firewall: Addressing the needs of industries (like aircraft maintenance) that require AI to stay strictly on-premises.

1. Enterprise AI Infrastructure

Red Hat AI: A commercial product offering tools for model customization, including pre-training, fine-tuning, and RAG (Retrieval-Augmented Generation).

Inference Engines: James highlights the difference between Llama.cpp (for smaller/edge hardware) and vLLM, which has become the enterprise standard for multi-GPU data center inferencing.

Sponsored By:

• Tailscale: Tailscale is the easiest way to create a peer-to-peer network with the power of Wireguard.

Links:

• Alby: Your Boost companion for the web — Help the show reach its 500K sat goal, and send your message to the show. Boost from the web with Alby.
• Coder Radio on the Podcastindex.org — You can boost from the web, top-up Alby, then head over to our entry on the Podcast Index :)
• Keep Linux Open and Free—We Can’t Afford Not To — Finally, to IBM, here’s a big idea for you. You say that you don’t want to pay all those RHEL developers? Here’s how you can save money: just pull from us. Become a downstream distributor of Oracle Linux. We will happily take on the burden.
• Traffic to OpenAI's ChatGPT fell almost 10% in June — Traffic to ChatGPT’s website fell by 9.7% over the month of June, according to preliminary estimates from Similarweb, a web analytics firm, released this week. The decline was even greater just in the U.S., with a 10.3% month-on-month decline. The number of unique visitors to ChatGPT also fell by 5.7% from the previous month.
• We’re Going Down A Very Dangerous Path With AI Regulation, Despite Better Options — Reading through the “SAFE Innovation Framework” is like a masterclass in the political game of making it sound like you’re saying something, while actually saying nothing at all:
• Chuck's MS Doc Exported to PDF SAFE Framework
• Katharina Koerner on Twitter — This article articulates the fear that with new AI regulations, big companies with the means to employ lawyers will dominate the AI market, and the more creative and innovative startups are shut out.
• Sarah Silverman is suing OpenAI and Meta for copyright infringement - The Verge — The lawsuits allege the companies trained their AI models on books without permission.
• Guillaume🐻 on Twitter — This version introduce `include` keyword which allow you to use an existing Compose configuration as part of your Compose stack
• RFC: publish a compose application on registry — I suggest we define a mechanism and media type to push a compose.yaml file to a registry, in addition to images, with adequate OCI references

Sponsored By:

• Tailscale: Tailscale is the easiest way to create a peer-to-peer network with the power of Wireguard.

Links:

• Try a new Podcast App, cool features inbound! — Chapters, transcriptions, Boosts, and more. Try a new podcast app!
• Alby: Boost from the Web — Create an Alby Account to get a lightning wallet for payments wherever you go.
• Coder Radio on the Podcastindex.org — You can Boost the show from the Podcast Index web page, just top off Alby first, then head over to the Index!
• Twitter bug causes self-DDOS tied to Elon Musk's emergency blocks and rate limits: "It's amateur hour" — For the last two days, Elon Musk has claimed that Twitter is under attack from “several hundred organizations” who were conducting “EXTREME levels of data scraping,” forcing them to bring “large numbers of servers online on an emergency basis” and enact emergency measures.
• Elon Musk on Twitter — Temporary emergency measure. We were getting data pillaged so much that it was degrading service for normal users!
• Kareem Carr | Data Scientist | 📊📈 on Twitter — Rate limiting starts the day their cloud contract (that they were having trouble paying) ends. This can’t be a coincidence right?
• LINUX Unplugged 517: Caught Red-Hatted — Just about every take on the Red Hat news seems to have missed the mark.
• Red Hat community contributions — Red Hat is a proud contributor to all aspects of the software stack, from the operating system and developer toolchain to middleware, desktop, and cloud. We financially support a number of open source organizations who help us create and maintain better open source software. We also contribute to a wide range of standardization efforts that help define future, interoperable technologies.
• Apple wants Xcode to write apps for you, automatically — "In an example, [the] code generator creates a subroutine that facilitates accessing values of the existing ML data," says Apple, "via the particular data type supported in the particular programming language"
• Report: Vision Pro Headset's Complex Design Forcing Apple to Make 'Drastic' Production Cuts — As a result of production challenges, Apple is preparing to make fewer than 400,000 units in 2024

Sponsored By:

• Linode: Receive a $100 60-day credit towards your new account. Promo Code: linode.com/coder
• Tailscale: Tailscale is the easiest way to create a peer-to-peer network with the power of Wireguard.

Links:

• Join our West Coast Crew Chat — Join our West Coast chat room for future events.
• What’s new for Apple developers - iOS 16 — Learn about the key technologies and exciting capabilities available in the latest SDKs
• iOS 16 Launches — Apple is set to release iOS 16 this Monday, September 12
• Apple iOS 16 review: unlocking the lock screen — Apple’s trying to turn your phone into more than just a bunch of apps
• iOS 16: The MacStories Review — Customization is back, and Apple’s having fun again.
• All the iOS 16 Features You Won't Get Until Later This Year
• iOS 16 - New Features - Apple
• iPhone 14 Pro Models Feature Improved GPS Accuracy — The new iPhone 14 Pro and iPhone 14 Pro Max feature dual-frequency GPS support for more accurate location tracking, according to Apple's tech specs for the devices.
• iPhone 14 Pro's Always-On Display Intelligently Turns Off When You Leave the Room With an Apple Watch — The always-on display on the iPhone 14 Pro and ‌iPhone 14 Pro‌ Max will intelligently and automatically turn off when a user leaves their iPhone in a room and walks out while wearing an Apple Watch.
• Grab a new Podcast app — Upgrade your podcast app with a Podcasting 2.0 compatible app.
• Chris' Fountain.FM link — Find Chris on Fountain.FM
• GrapheneOS — The private and secure mobile operating system with Android app compatibility. Developed as a non-profit open source project.
• Moon Cards — Pay at millions of online merchants with secure virtual cards.
• Instacart Plans to Focus IPO on Selling Employee Shares — Most shares listed will come from employees, in a move that could help the delivery company retain and recruit talent