2025-10-03 13:14
🚀 Exciting news in AI! DeepSeek-V3.2-Exp has launched, introducing Sparse Attention for efficient long-context inference. This two-stage process aims to lower costs by up to 50% for API calls. Supported by vLLM from Day 0, it runs on NVIDIA Hopper and Blackwell architectures, enabling immediate experimentation. Red Hat AI users can deploy it seamlessly on their platforms. Learn more about optimizing your long-context tasks! #AI #MachineLearning #DeepLearning #RedHatAI #NVIDIA
Source: Red Hat Developer Blog
Saša Zelenović, Tyler Michael Smith, Tarun Kumar, Taneem Ibrahim
2025-10-03 07:00
🚀 Discover the Red Hat Offline Knowledge Portal, designed for users in low-bandwidth or disconnected environments. This tool consolidates essential Red Hat information, including documentation and security data, into a portable container image. 🛠️ The article provides a step-by-step guide for deploying the portal on an OpenShift cluster, including prerequisites like OpenShift cluster access and Podman installation. 📥 Key steps involve downloading the image, transferring it, and deploying it...
Source: Red Hat Developer Blog
Abdoul Djire, Teg-Wende Regis Nare
2025-10-02 07:00
Unlock the power of efficient LLM serving with OpenShift AI! 🚀 This article discusses how vLLM and KServe enable autoscaling of model servers, optimizing GPU resource utilization. It highlights the Serverless deployment mode, allowing scaling based on concurrent requests, and the future potential for RawDeployments using KEDA. Key prerequisites for setup include the NVIDIA GPU Operator and OpenShift Serverless. The article also provides a step-by-step guide on deploying models and configuring...
Source: Red Hat Developer Blog
Trevor Royer
2025-10-02 07:00
Discover the potential of packet filtering with Retis! 🌐 This article explores how Retis allows packet dumps from anywhere in the networking stack. It highlights its unique filtering methods: packet filtering and metadata filtering, which help manage data, ensuring accurate captures and reducing overhead. Learn how Retis compares to tools like tcpdump and tshark, emphasizing the importance of precise filtering for effective network debugging. #NetworkEngineering #PacketFiltering #Retis...
Source: Red Hat Developer Blog
Paolo Valerio
2025-10-02 07:00
🚀 PostGIS is a geospatial extension for PostgreSQL, enhancing the database's ability to manage geographic data. It supports operations like distance calculations and spatial joins, making it ideal for GIS applications. 🔧 Installation requires compatible PostgreSQL versions, currently supporting PostgreSQL 16 on RHEL 9 and 10. 📊 Users can create tables with various geometric types and utilize raster data analysis through PostGIS. For detailed setup instructions, refer to the full article!...
Source: Red Hat Developer Blog
Lukas Javorsky, Ales Nezbeda
2025-10-01 07:01
Managing sensitive information in cloud-native platforms like OpenShift is essential for security. 🌐 This article discusses two methods for accessing secrets: environment variables and volume mounts. While both are supported, volume mounts are recommended for better security and control. 🔒 Volume mounts automatically update sensitive data and limit exposure, ensuring only necessary credentials are accessed by applications. In contrast, environment variables carry risks of accidental exposure...
Source: Red Hat Developer Blog
Hardik Vyas
2025-10-01 07:01
🚀 The Model Context Protocol (MCP), introduced by Anthropic in November 2024, standardizes AI interactions with large language models. Its rapid adoption has led to a surge in MCP servers for local development. 🛠️ ToolHive, developed by Stacklok, facilitates the deployment and management of these servers on Kubernetes and OpenShift. It includes a GUI for local developers and an operator for Kubernetes orchestration. 🔧 To get started, ensure you have Helm and access to an OpenShift-based...
Source: Red Hat Developer Blog
rkieley
2025-09-30 07:00
Changing the default Python interpreter on RHEL requires caution. The alternatives command, previously used, is unsupported in RHEL 9 and later due to potential system risks. Modifying the system Python can disrupt core components like dnf, affecting system management. A safer approach is to create a symbolic link to your desired Python version without altering the system Python. This method is easy to reverse and maintains system integrity. For script portability, use `#!/usr/bin/env...
Source: Red Hat Developer Blog
Tomáš Hrnčiar
2025-09-30 07:00
🔍 Exploring LLM Inference Engines: vLLM vs. llama.cpp This article compares two powerful inference engines, highlighting their distinct features. vLLM is built for high-throughput, multi-user scenarios, excelling in scalability and responsiveness. It delivers rapid responses even under heavy loads. In contrast, llama.cpp focuses on efficiency and portability, ideal for single-user tasks and consumer-grade hardware. Its C++ architecture allows for quick loading and minimal dependencies. For...
Source: Red Hat Developer Blog
Harshith Umesh
2025-09-29 07:00
Learn how to implement and monitor circuit breakers in OpenShift Service Mesh 3.0 to enhance your application's resilience! ⚡ This guide outlines the steps to configure, trigger, and monitor a circuit breaker that isolates unhealthy services, helping prevent system-wide failures. Key prerequisites include having an OpenShift cluster and the Bookinfo application set up. The tutorial also covers using Kiali for monitoring. 📊 For detailed instructions, check out the full guide! #OpenShift...
Source: Red Hat Developer Blog
Shailendra Kumar Singh
2025-09-29 07:00
In the Red Hat OpenShift Container Platform, the node-system-admin-client certificate plays a vital role in securing internal communication. This article analyzes its lifecycle, revealing a mismatch between its intended two-year validity and the actual one-year expiration due to constraints from its signing Certificate Authority (CA). It also highlights the manual rotation of certificates and the steps needed to renew them effectively. 🔄🔍 #OpenShift #PKI #Certificates #RedHat #ContainerSecurity
Source: Red Hat Developer Blog
George Zheng Wang
2025-09-26 07:01
Explore the advancements of Red Hat OpenShift Service Mesh 3! 🚀 This article highlights its robust support for multi-cluster topologies, transforming independent clusters into a unified application network. It emphasizes secure inter-cluster communication through dedicated gateways. Learn about the benefits of enhanced scalability, fault tolerance, and seamless failover patterns. A step-by-step guide is provided for creating a multi-cluster architecture. #OpenShift #ServiceMesh #MultiCluster...
Source: Red Hat Developer Blog
Maya Blonder
2025-09-25 07:00
🚀 Explore the Kubernetes MCP server, an AI-powered extension for Kubernetes and OpenShift! This tool allows AI assistants like VS Code and Microsoft Copilot to interact safely with your clusters. It simplifies cluster management through natural language commands and supports secure access via least-privilege ServiceAccounts. Key features include no external dependencies, support for generic Kubernetes resources, and advanced pod operations. Currently in developer preview, it encourages...
Source: Red Hat Developer Blog
Gaurav Singh, Arda Guclu, Marc Nuri San Felix, Dave Gordon
2025-09-25 07:00
🚀 Red Hat OpenShift Service Mesh 3 enhances traffic management, observability, and security for microservices. As applications grow, so do the complexities of routing and securing communications. OSSM 3 introduces Envoy proxies to streamline these processes, ensuring secure service interactions and better traffic control. With features like mutual TLS for security, canary deployments for testing, and enhanced observability tools, teams can manage their microservices more effectively....
Source: Red Hat Developer Blog
Maya Blonder
2025-09-25 07:00
Explore the deployment of the DialoGPT-small language model on OpenShift AI for internal testing. This guide details setting up your environment, configuring ServingRuntime, and deploying an inference service, all within a secure, cloud-native environment. Key steps include verifying components, managing model storage with PVCs, and running tests without exposing external endpoints. This workflow is intended for internal evaluation only. For production use, refer to official documentation....
Source: Red Hat Developer Blog
Christina Zhang
2025-09-24 07:00
Discover the power of Skopeo, an essential tool in the Linux container-tools ecosystem. 🌟 Skopeo allows you to inspect and copy container images efficiently without downloading them first. This is especially useful for developers using Kubernetes clusters. It simplifies many tasks typically done with Podman, making workflows smoother. From inspecting remote images to syncing multiple registries, Skopeo enhances your container management experience. 🌐🔧 #Linux #ContainerTools #Skopeo #DevOps...
Source: Red Hat Developer Blog
Fernando Lozano
2025-09-24 07:00
Managing certificates in IT can be challenging. Many DevOps engineers and IT managers face time-consuming manual tasks, risking governance and security. This article discusses automating the certificate lifecycle in Red Hat OpenShift using the cert-manager operator with Venafi. It offers a solution that enhances efficiency and security. By transitioning from traditional to modern certificate management, teams can minimize errors and focus on innovation. The cert-manager operator simplifies...
Source: Red Hat Developer Blog
Ajay Kanse
2025-09-23 07:01
🚀 Exciting news for OpenShift users! Red Hat introduces "on-cluster" image mode for Red Hat Enterprise Linux CoreOS, allowing seamless customization at scale. This cloud-native approach treats your OS like a container image, enabling you to define configurations as code. You can now add drivers, deploy hotfixes, and maintain customizations during upgrades directly from your cluster. OpenShift 4.19 and EUS users on 4.18.21 can fully utilize this capability. The streamlined build process...
Source: Red Hat Developer Blog
Mark Russell
2025-09-23 07:01
Deploying machine learning models poses unique challenges, especially with fluctuating traffic levels. Traditional autoscaling methods often fall short, leading to inefficiencies. This article discusses setting up KServe autoscaling using vLLM and KEDA. This approach focuses on application-specific metrics, enabling efficient scaling tailored to AI workload demands. Learn about the process, including exposing metrics to Prometheus and configuring KEDA for optimal performance. 🌐📈...
Source: Red Hat Developer Blog
Alberto Perdomo
2025-09-23 07:01
🚀 Migrating code can be tough, but Cursor AI simplifies the process! Our team transitioned a Bash test suite to Python using the Cursor AI code editor. After installing and logging in, we enabled specific AI models to assist with the migration. Cursor helped analyze the Bash scripts, generated a Python library, and created basic tests automatically. The result? A significant time-saving of about 1.5 months! For a detailed look at the process, check our documentation. #CodeMigration #CursorAI...
Source: Red Hat Developer Blog
Petr Hracek
2025-09-22 07:01
📣 Exciting news for developers! Python 3.13 is now available in the EPEL repository for Red Hat Enterprise Linux (RHEL) 9 and 10. This allows users to access the latest Python features seamlessly. To install, ensure the EPEL repository is enabled and run: `sudo dnf install python3.13` Verify the installation with: `python3.13 --version` For project management, consider using virtual environments to isolate dependencies. Learn more about how EPEL supports software availability while...
Source: Red Hat Developer Blog
Karolina Surma
2025-09-22 07:01
🚀 Exciting advancements in cloud automation! The latest blog post discusses the Red Hat Ansible Certified Content Collection for amazon.aws 10.0.0. It highlights the amazon.aws.aws_ssm connection plug-in that enhances security by eliminating SSH access and public IPs. Key features include: - Secure provisioning of EC2 instances using Terraform - Management of tasks via Ansible over SSM - Dynamic inventory for automated resource discovery This approach supports zero trust networking and...
Source: Red Hat Developer Blog
Alina Buzachis
2025-09-18 07:00
🚀 Cloud bursting enhances on-premises applications by extending them to the cloud during peak demand. 🔒 Secure connectivity ensures that cloud resources can access on-premises data seamlessly. Confidential computing adds a layer of security, protecting sensitive information even in untrusted environments. 🛠️ This article details how to set up a cloud-bursting scenario from an OpenShift cluster to Azure using confidential containers and OpenVPN. #CloudBursting #OpenShift #ConfidentialComputing...
Source: Red Hat Developer Blog
Pradipta Banerjee, Pei Zhang
2025-09-18 07:00
🚀 New advancements in GPU acceleration for AI inference on macOS! Recent developments showcase how llama.cpp now achieves native speed performance in most use cases. By leveraging a thin virtualization layer, containers can run efficiently on macOS. This enhancement utilizes the API remoting architecture, allowing optimized GPU access in virtualized environments. Key components include ggml-remoting and libkrun's virtio-gpu, which enable seamless communication between the virtual machine and...
Source: Red Hat Developer Blog
Kevin Pouget
2025-09-17 12:33
🚀 Dive into the KRaft protocol of Apache Kafka! This article explores the key concepts and implementation of KRaft in version 4.1.0. It highlights how KRaft simplifies Kafka operations by eliminating the need for ZooKeeper and addressing scalability and consistency issues. The guide covers important elements like consensus algorithms, leader election, log replication, and safety rules essential for distributed systems. Developers and engineers looking to enhance their understanding will find...
Source: Red Hat Developer Blog
Federico Valeri
2025-09-17 07:01
🚀 In 2024, over 40,000 Common Vulnerabilities and Exposures (CVEs) were reported, marking a 38% rise from 2023. The trend of increasing CVEs is expected to continue into 2025, with projections of up to 58,956 new CVEs. 🔒 Kernel live patching has emerged as a crucial practice for applying security updates without downtime. This allows OpenStack Services on OpenShift users to maintain system integrity while minimizing interruptions. 🖥️ For more details, check out the article on kernel live...
Source: Red Hat Developer Blog
Pedro Navarro Perez
2025-09-17 07:01
🔒 In today's digital world, securing DNS traffic is crucial. Unencrypted DNS queries can expose sensitive information to eavesdroppers, leading to potential data breaches. 🔍 Encrypted DNS, particularly DNS over TLS (DoT), is now available in Red Hat Enterprise Linux 10 and 9.6. This advancement strengthens network security by ensuring that DNS queries are kept private and verifiable. 🛠️ The article provides a step-by-step guide for implementing encrypted DNS to improve system security during...
Source: Red Hat Developer Blog
Dominika Borges, Pavel Březina, Francisco Trivino Garcia
2025-09-16 07:00
🚀 Discover the Red Hat Ansible Lightspeed intelligent assistant in the latest Red Hat Ansible Automation Platform 2.6! This integrated chatbot utilizes various inference backends and can be deployed with Red Hat OpenShift AI. The article provides a step-by-step guide for installing OpenShift AI and setting up an inference service on the same cluster. Key topics include: - Installing OpenShift AI - Deploying an Inference Service - Configuring Ansible Lightspeed Stay tuned for more insights in...
Source: Red Hat Developer Blog
Riya Sharma, Elijah DeLee
2025-09-15 07:00
AI developers are exploring a shift from Python to Rust for agentic AI solutions. While Python is popular for its simplicity and rich libraries, its Global Interpreter Lock (GIL) limits performance in CPU-bound tasks, especially as systems scale from 5 to 500 agents. Rust offers a solution with better concurrency and scalability, allowing more efficient handling of multiple agents and CPU-intensive tasks. Developers are finding that a hybrid approach—prototyping in Python and optimizing with...
Source: Red Hat Developer Blog
Louis Imershein
2025-09-15 07:00
🔍 Discover the essentials of Confidential Virtual Machines (CVMs) and their role in enhancing the security of confidential containers (CoCo). CVMs utilize hardware and software to ensure data confidentiality, isolating workloads from the host environment. This integration with Red Hat Enterprise Linux (RHEL) and OpenShift boosts security standards for data in use. 🛡️ Learn about features like Unified Kernel Images (UKI) and remote attestation that enhance the protection of workloads....
Source: Red Hat Developer Blog
Emanuele Giuseppe Esposito
2025-09-15 07:00
Deploying and benchmarking large language models (LLMs) in air-gapped environments is vital for regulated enterprises. This article details the process of using the Red Hat AI Inference Server with vLLM and GuideLLM for performance evaluation within a disconnected OpenShift cluster. Key components include prebuilt container images, Persistent Volume Claims (PVCs), and OpenShift-native Job resources. GuideLLM, an open-source tool, provides metrics like token throughput and latency, ensuring...
Source: Red Hat Developer Blog
Philip Hayes, Thameem Abbas Ibrahim Bathusha
2025-09-12 22:59
🚀 Exciting news in AI! The Qwen3-Next model features a new hybrid attention and sparse MoE architecture, enhancing training efficiency and inference speed. 🔧 With Day 0 support from vLLM, organizations can deploy it immediately using Red Hat AI for secure and scalable solutions. 📊 Key improvements include multi-token prediction and optimized training stability. For a step-by-step guide on deployment, check the latest blog! #AI #RedHat #OpenSource #MachineLearning #Qwen3Next
Source: Red Hat Developer Blog
clobner
2025-09-12 07:01
Discover how to enhance AI application observability using Python and Llama Stack! 🚀 This article highlights the importance of observability in production, focusing on logging, metrics, and distributed tracing. It introduces OpenTelemetry as a key tool for instrumenting applications and discusses setting up Jaeger for trace visualization. Explore the detailed steps for implementing observability, including configuring your Llama Stack instance to capture and visualize traces effectively....
Source: Red Hat Developer Blog
Michael Dawson
2025-09-12 07:01
🚀 Ready to explore AI? This tutorial provides a step-by-step guide to deploy a lightweight AI model, Llama-3.2-1B, using the Red Hat AI Inference Server. It’s designed for quick testing on personal machines with local GPUs. 🔧 You'll need a valid Red Hat account and a compatible GPU. The tutorial covers everything from logging in to the Red Hat container registry to running the model with minimal setup. For more details, check out the tutorial! #AI #RedHat #MachineLearning #Containerization...
Source: Red Hat Developer Blog
Christina Zhang
2025-09-11 07:01
Introducing the vLLM Semantic Router, an open-source solution for enhancing efficiency in AI reasoning. 🎉 This system intelligently routes queries based on their complexity, ensuring that resources are used wisely. It utilizes a ModernBERT-based classifier for semantic classification, sending simpler requests to faster models and more complex ones to stronger models. Key benefits include improved accuracy (+10.2%), reduced latency (–47.1%), and decreased token usage (–48.5%). This approach...
Source: Red Hat Developer Blog
Huamin Chen
2025-09-11 07:00
🔍 Virtual machines often require DNS records to maintain unique identities. This article discusses how to declaratively assign these records using Red Hat OpenShift Virtualization. 📊 It highlights the importance of naming conventions and provides methods to automate DNS record assignments via labels and annotations. 🔧 Key considerations include network exposure, IP assignment, and managing multiple DNS records for diverse network interfaces. #VirtualMachines #DNSManagement #OpenShift #GitOps...
Source: Red Hat Developer Blog
Raffaele Spazzoli
2025-09-10 07:00
🚀 Red Hat OpenShift AI is transforming the deployment of language models! This guide explores the OpenShift AI console, your hub for managing data science projects. You can easily deploy models like Llama, leveraging GPU acceleration and resource scaling. Key features include project dashboards, model tracking, and multiple storage options. Check out the step-by-step deployment process for Llama, from GPU setup to testing both internal and external access. 🔗 Watch the full video demo for a...
Source: Red Hat Developer Blog
Alicia Cao
2025-09-10 07:00
Unlocking fashion e-commerce with AI! 🛍️✨ Traditional keyword searches often miss the mark in understanding customers' true intent. This article highlights a solution using semantic search, which captures meaning and intent in fashion searches. EDB Postgres AI and Red Hat OpenShift AI work together to process AI data, enabling seamless visual and text searches. Users can upload images or describe items without needing exact terms. This innovative approach not only enhances search accuracy but...
Source: Red Hat Developer Blog
Shane Heroux
2025-09-09 14:00
Unlock development potential with the Red Hat Developer Subscription for Teams! 🚀 This program provides organizations using Red Hat technologies free access to Red Hat Enterprise Linux for development activities. It's available via Red Hat representatives or self-service at developers.redhat.com. Key activities covered include software design, coding, building, testing, and pre-production setups. The subscription supports efficient application development and deployment. For more details,...
Source: Red Hat Developer Blog
Josh Swanson, Brian Gollaher
2025-09-09 07:01
Unlock the power of OpenAI's gpt-oss models locally with RamaLama! 🖥️ These models, available in 20B and 120B variants, enable advanced AI capabilities right on your machine. RamaLama simplifies the setup process using containerization for security and ease. 🚀 Key features include zero trust security and automatic GPU optimization. Get started easily with just a single command. Explore more about running AI models in a secure, efficient manner! 🔒✨ #OpenAI #AIModels #RamaLama #MachineLearning...
Source: Red Hat Developer Blog
Cedric Clyburn