Articles from Source: Red-Hat-Developer-Blog

Using DNS over TLS in OpenShift to secure communications

2025-09-09 07:01
πŸ”’ Secure your DNS traffic in Red Hat OpenShift with DNS over TLS (DoT). This feature enhances security by ensuring all DNS communications are encrypted, aligning with zero trust architecture principles. πŸ› οΈ The recent RHEL 10 release introduces encrypted DNS, allowing DoT during installation and runtime. While currently a Technology Preview in Identity Management (IdM), it lays the groundwork for secure operations. πŸ” Explore installation steps for IdM and OpenShift, including configuring DNS...
Source: Red Hat Developer Blog
Josep Andreu Font, Ramon Gordillo Gutierrez

Scaling DeepSeek and Sparse MoE models in vLLM with llm-d

2025-09-08 14:02
πŸš€ Exciting advancements in scaling Mixture of Experts (MoE) models with vLLM and the llm-d project are transforming open-source LLM capabilities. 🌐 This article discusses innovations like multi-head latent attention and sparse configurations, enabling efficient deployment in Kubernetes. Learn how vLLM enhances expert parallelism and communication for large models. For detailed insights, check the full article! πŸ“Š #MachineLearning #AI #Kubernetes #DeepLearning #OpenSource
Source: Red Hat Developer Blog
Robert Shaw, Tyler Smith

Scaling DeepSeek-style MoEs with vLLM and llm-d using Wide EP

2025-09-08 14:02
πŸ” Exciting advancements in serving large-scale Mixture of Experts (MoE) language models are discussed in a recent article on vLLM and llm-d. The article covers the architectural changes in vLLM that enhance the efficiency of DeepSeek-style models. Key innovations include multi-head latent attention and sparse configurations with hundreds of experts. llm-d enables high-performance deployments in Kubernetes, offering intelligent scheduling and expert parallelism for efficient scaling. Learn...
Source: Red Hat Developer Blog
Robert Shaw, Tyler Smith

Multicluster authentication with Ansible Automation Platform

2025-09-08 07:00
Implementing multicluster authentication between Red Hat Ansible Automation Platform and Red Hat Advanced Cluster Management can enhance security and streamline operations. This integration allows for centralized authentication, reducing credential proliferation. Key features include dynamic token management and network security via Cluster Proxy. For successful implementation, ensure both ManagedServiceAccount and Cluster Proxy are enabled in your setup. Access detailed steps and best...
Source: Red Hat Developer Blog
Alberto Filice

Verify Cosign bring-your-own PKI signature on OpenShift

2025-09-08 07:00
πŸš€ Red Hat OpenShift 4.16 introduces ClusterImagePolicy and ImagePolicy for sigstore verification. These tech preview features support Fulcio CA and public key policies. πŸ” The bring-your-own PKI (BYO-PKI) feature, available from OpenShift 4.19, allows validation of container images using existing X.509 certificates. πŸ”§ The article outlines how to sign images with Cosign and configure OpenShift for signature verification using ClusterImagePolicy. #OpenShift #Cosign #BYOPKI #ContainerSecurity...
Source: Red Hat Developer Blog
Qi Wang

What's new in network observability 1.9

2025-09-05 07:01
πŸš€ Exciting updates in Network Observability 1.9! This version enhances insights into network traffic with features like IPsec tracking, flowlogs-pipeline filter queries, and UDN mapping. It is compatible with Red Hat OpenShift Container Platform 4.19 and older releases. Learn how to enable IPsec and explore the new CLI enhancements for capturing flows, metrics, and packets. For detailed installation instructions, refer to the OpenShift documentation. πŸ“ŠπŸ” #NetworkObservability #RedHat...
Source: Red Hat Developer Blog
Steven Lee

Customize your deployments with the Red Hat Developer Hub Operator

2025-09-04 16:53
πŸš€ The Red Hat Developer Hub enhances internal developer portals when paired with Red Hat OpenShift. Key updates in version 1.2 include: - A new Argo CD front-end plug-in for better UX. - Enhanced orchestration capabilities for software templates. - Improved provenance tracking through ScaffoldedFrom metadata. Deployment is streamlined using the Red Hat Developer Hub Operator. Access your Backstage instance easily with the provided route. For detailed customization, a Backstage custom resource...
Source: Red Hat Developer Blog
Francisco De Melo Junior

How to migrate from Fluentd to Vector in OpenShift 4

2025-09-04 07:01
πŸ”„ **Migrating from Fluentd to Vector in OpenShift 4** πŸ”„ This article provides a comprehensive guide for migrating the default log collector in OpenShift 4 from Fluentd to Vector. With Fluentd being deprecated in Logging 5.X, this transition is essential to access the new features in Logging 6.0. Vector serves as a log collector and analyzer, simplifying the processing of logs for real-time analysis. It allows logs to be sent to destinations like Amazon CloudWatch and supports JSON formatted...
Source: Red Hat Developer Blog
Calvin Lee, Jamie Parker

How platform engineering accelerates enterprise AI adoption

2025-09-04 07:01
πŸš€ Platform engineering is reshaping enterprise AI adoption. By integrating technologies like Kafka and service mesh, organizations can enhance AI deployments. πŸ” Key challenges include reproducibility and compliance. Platform engineering addresses these by providing self-service access and standardized environments, enabling developers and data scientists to innovate efficiently. πŸ’» Red Hat OpenShift and Developer Hub are pivotal in making AI resources accessible while ensuring governance. #AI...
Source: Red Hat Developer Blog
Maarten Vandeperre, Camille Nigon

How to deploy Azure Red Hat OpenShift using Terraform

2025-09-04 07:01
πŸš€ Learn how to deploy Azure Red Hat OpenShift using Terraform! This article covers the steps to set up and configure your Azure infrastructure with Terraform, ensuring compliance using Azure policies. It emphasizes the importance of governance rules and the use of policy-as-code for better resource management. Key prerequisites include Terraform CLI, Azure CLI, and proper role assignments. The setup involves creating a network, configuring security, and deploying the OpenShift cluster with...
Source: Red Hat Developer Blog
Mario Dietner

Effective observability with Red Hat build of OpenTelemetry

2025-09-03 07:01
πŸš€ Discover the power of observability with the Red Hat build of OpenTelemetry! This framework enables comprehensive metrics and logs reporting, crucial for monitoring your applications and infrastructure. It simplifies data collection and management while providing scalability and flexibility. Key features include: - Unified data collection - Seamless integration with monitoring tools - Enterprise-grade support from Red Hat Explore how to get started and enhance your observability practices!...
Source: Red Hat Developer Blog
Giovanni Fontana

vLLM with torch.compile: Efficient LLM inference on PyTorch

2025-09-03 07:01
πŸš€ Efficient LLM inference is crucial in today’s diverse tech landscape. The article discusses how **torch.compile**, PyTorch's JIT compiler, streamlines performance by automatically optimizing kernels. This reduces the burden on developers, allowing them to focus on model design rather than manual tuning. Incorporated into **vLLM**, torch.compile enhances usability and performance through custom compiler passes. It supports dynamic batch sizes and improves startup times with caching...
Source: Red Hat Developer Blog
Luka Govedič, Addie Stevens, Michael Goin, SaΕ‘a ZelenoviΔ‡

Your LLM is too large: How I generate production-ready failure analysis on a toaster

2025-09-02 07:00
Running production-grade Kubernetes failure analysis on a cost-effective edge device can streamline troubleshooting. Using Llama 3.2:3B with 4-bit quantization, root cause analysis is achieved in just 70 seconds. This method incorporates pattern preprocessing to efficiently identify known failures without overwhelming the system with raw logs. Real-world results show a significant cost reduction, from $0.30-3.00 per analysis to less than $0.001, while providing actionable insights. Explore...
Source: Red Hat Developer Blog
Caleb Evans

Migrate your OpenShift logging stack from Elasticsearch to Loki

2025-09-01 07:01
πŸš€ To leverage the latest logging features in Red Hat OpenShift 6.0, migrating from Elasticsearch to Loki is essential. This guide details how to test changes in development and plan for production implementations. Loki, a scalable log aggregation system, offers improved performance by using log labels. It allows multiple tenants, which simplifies resource management. πŸ”„ The migration process involves running both stacks in parallel, ensuring old logs remain accessible via Elasticsearch while...
Source: Red Hat Developer Blog
Oscar Casal Sanchez, Jamie Parker

Migrating Ansible Automation Platform 2.4 to 2.5

2025-08-29 07:01
πŸš€ Migrating from Ansible Automation Platform 2.4 to 2.5 involves careful steps to ensure a smooth transition. This article outlines the preparation, export, and import process using the configify.aapconfig collection. Key points include: - Ensure Ansible Automation Platform 2.5 is deployed separately. - Follow similar steps as migrating from AWX 25. - Focus on user roles and authentication changes in the new version. For detailed steps, refer to the article! πŸ“œ #Ansible #Automation #DevOps...
Source: Red Hat Developer Blog
Konstantin Kuminsky

Multicluster resiliency with global load balancing and mesh federation

2025-08-28 07:01
Explore the new architecture for multicluster resiliency using global load balancing and mesh federation! 🌐 This approach combines a global load balancer and a federated service mesh to enhance service availability and disaster recovery, particularly for stateless workloads. New capabilities in Red Hat OpenShift Service Mesh 3.0 and Red Hat Connectivity Link now allow for more robust deployments. Learn how to configure these tools for optimal performance! #Multicluster #RedHat #CloudComputing...
Source: Red Hat Developer Blog
Raffaele Spazzoli

Simplify local prototyping with Camel JBang infrastructure

2025-08-28 07:01
πŸš€ Apache Camel simplifies integration with systems like databases and APIs through minimal coding. 🌟 Camel JBang, a command-line interface, enhances prototyping by allowing rapid creation and testing of integration flows without complex setups. πŸ”§ Its infra command quickly launches backends like Kafka or ActiveMQ, streamlining the development process and reducing setup time. For more details, check out the full article! #ApacheCamel #CamelJBang #Integration #Development #Prototyping
Source: Red Hat Developer Blog
Bruno Meseguer

Smart deployments at scale: Leveraging ApplicationSets and Helm with cluster labels in Red Hat Advanced Cluster Management for Kubernetes

2025-08-27 07:01
Managing multiple Kubernetes clusters can be complex, but Red Hat Advanced Cluster Management simplifies this process. 🌐 It offers a centralized platform to oversee the entire lifecycle of Kubernetes clusters, ensuring consistent health monitoring and policy enforcement across environments. Combining ApplicationSets and Helm with cluster labels allows for tailored deployments, adapting configurations based on specific cluster characteristics. This integration streamlines operations and...
Source: Red Hat Developer Blog
Mikel Sanchez

How to verify container signatures in disconnected OpenShift

2025-08-27 07:01
πŸ” Discover how to verify container signatures in disconnected OpenShift environments using the latest tools from sigstore! The article explores the use of oc-mirror v2 in Red Hat OpenShift 4.19, allowing mirroring of container images and their cryptographic signatures. It provides a proof of concept and detailed configuration steps for enabling signature verification with CoSign. Check it out for practical insights! πŸ› οΈπŸ”’ #OpenShift #ContainerSecurity #Sigstore #RedHat #DevOps
Source: Red Hat Developer Blog
Mohammad Ahmad, Tom Stockwell, Alex Guidi, Jack Adolph

Event-driven ingestion of Keycloak entities

2025-08-27 07:01
πŸš€ Discover a solution to delayed updates in entity information with the Backstage Events System! This article details a Proof of Concept (PoC) that enables near real-time synchronization of Keycloak entities into Red Hat Developer Hub (RHDH). Key benefits include immediate updates and efficient, incremental syncing, reducing API calls and CPU usage. Learn how to set up the PoC and optimize your developer catalog! πŸ”— Check out the PoC code: [GitHub Link] #Keycloak #RedHat #EventDriven...
Source: Red Hat Developer Blog
Kashish Mittal

BGP dynamic routing with Fast Data Path on RHOSO 18

2025-08-27 07:01
Exploring the performance of dynamic routing with OVN-BGP-Agent and Fast Data Path on RHOSO 18 has yielded insightful findings. πŸš€ A recent Proof of Concept assessed throughput, packet loss, stability, and resource utilization using Trex and BIRD. The results show high throughput, especially with large frames, and stable performance over extended periods. πŸ“ˆ However, there are limitations, including bottlenecks for small packets and some manual configuration challenges. Insights from this study...
Source: Red Hat Developer Blog
Pradipta Sahoo, Spoorthi K, Haresh Khandelwal

A VM tuning case study: Balancing power and performance on AMD processors

2025-08-26 07:01
During a server deployment, a significant performance gap was found between bare metal and virtual machine (VM) workloads. Optimizations, including adjusting system profiles and enabling CPU scaling drivers, were implemented. These changes resulted in notable improvements in VM performance, with the tuned VM even surpassing the original bare-metal completion times. The study highlights how targeted adjustments can lead to substantial gains in efficiency. πŸ”§πŸ’»βš‘οΈ #VMTuning...
Source: Red Hat Developer Blog
Kevin Buettner

Optimize GPU utilization with Kueue and KEDA

2025-08-26 07:01
Explore how integrating Kueue and KEDA can optimize GPU utilization in AI workloads! πŸš€ This proof of concept showcases a method to enhance resource efficiency on OpenShift AI. The combination allows scaling long-running workloads to zero when idle, reducing costs significantly. Learn how to implement this strategy with a focus on resource management and effective workload scheduling. πŸ“ŠπŸ’» #AI #GPUUtilization #OpenShift #Kubernetes #CloudComputing
Source: Red Hat Developer Blog
Christian Zaccaria

Implement AI safeguards with Python and Llama Stack

2025-08-26 07:01
πŸš€ Exploring AI safety with Llama Stack! This article highlights how to implement guardrails in AI applications using Python and Llama Stack. It introduces two main built-in guardrails: Llama Guard, which filters unsafe content, and Prompt Guard, designed to prevent circumvention of safety measures. The post provides insights into setting up Llama Stack and utilizing these guardrails effectively in Python. #AI #LlamaStack #Python #MachineLearning #AIsafety
Source: Red Hat Developer Blog
Michael Dawson

LLM Compressor 0.7.0 release recap

2025-08-25 16:09
πŸš€ LLM Compressor has released version 0.7.0, enhancing performance for quantizing large language models. Key updates include: 1️⃣ New QuIP and SpinQuant-style transforms for improved accuracy. 2️⃣ Mixed-precision support with FP4 enhancements for better layer quantization. 3️⃣ DeepSeek v3-style block quantization for efficient compression without calibration data. Explore more about these features! #LLMCompressor #AI #MachineLearning #Quantization #TechUpdate
Source: Red Hat Developer Blog
Dipika Sikka, Kyle Sayers, Brian Dellabetta, Helen Zhao

What is an image mode 3-way merge?

2025-08-25 07:01
πŸ” Curious about the 3-way merge in Red Hat Enterprise Linux (RHEL)? In image mode, a new filesystem image is created to manage updates. This process includes a third version, older than the current and new images, to reduce conflicts. The merge prioritizes local changes, ensuring personalized settings remain intact. Utilizing OSTree, RHEL manages multiple OS installations effectively, making the merging process smoother. πŸ–₯️✨ #RedHat #Linux #3WayMerge #OSTree #TechUpdates
Source: Red Hat Developer Blog
Matt Micene

Least-privilege installation of OpenShift IPI on AWS

2025-08-22 07:16
πŸ”’ The latest guide on installing OpenShift IPI on AWS emphasizes a secure, least-privilege approach. By using the cloud credential operator utility (ccoctl) and setting credentials mode to manual, users can create narrowly-defined IAM roles. πŸ› οΈ This method eliminates long-lived AWS access keys, relying instead on short-term AWS STS credentials. The ccoctl --dry-run feature allows for auditing IAM policies before applying them, enhancing security. πŸ“Š Key points include understanding the IAM...
Source: Red Hat Developer Blog
Mohammad Ahmad, Thuan Vo

Integrate Azure DevOps into Red Hat Developer Hub workflows

2025-08-22 07:16
πŸš€ Exciting news for developers! Integrating Azure DevOps with Red Hat Developer Hub creates a seamless CI/CD experience. Azure DevOps enhances source control and deployment, while Red Hat Developer Hub centralizes tools and documentation. Key plug-ins include Azure Scaffolder and Azure DevOps, enabling improved collaboration and faster delivery. For setup, ensure Azure Entra ID is configured and follow the detailed steps for integration. Learn more about optimizing your workflows!...
Source: Red Hat Developer Blog
Sumiran Chugh, Zheng Wang (George)

How to auto-register Red Hat Edge Manager with MicroShift

2025-08-21 07:01
πŸš€ Red Hat Edge Manager, in Technology Preview, offers a fleet management solution for edge devices. It ensures security, simplifies management, and provides real-time visibility. πŸ”§ The article details how to auto-register Edge Manager with Red Hat MicroShift using Red Hat Advanced Cluster Management for Kubernetes 2.13. πŸ“‹ Key steps include enabling Edge Manager, setting up the flightctl command, and configuring auto-registration. Explore how these tools can enhance your edge device...
Source: Red Hat Developer Blog
Hui Chen, Zhao Xue, Jacob Berger

The hidden pitfalls of Kafka tiered storage

2025-08-21 07:01
πŸš€ Apache Kafka 3.9.0 introduces tiered storage for improved long-term data retention and cost efficiency. This feature allows independent scaling of compute and storage resources, leading to better client isolation. However, challenges remain in reading remote data. The article outlines two key problems and offers solutions, emphasizing important configurations like `fetch.max.bytes` and `max.partition.fetch.bytes`. Kafka 4.2.0 promises improvements to address these issues, enhancing...
Source: Red Hat Developer Blog
Federico Valeri, Luke Chen

Unleash controlled chaos with krknctl

2025-08-21 07:01
Unleash the power of chaos engineering with **krknctl**! πŸŽ‰ This command-line interface simplifies testing system resilience by orchestrating chaos scenarios using container images from krkn-hub. Key features include instant autocompletion, dynamic graph orchestration, and versatile container support with Podman or Docker. With pre-compiled binaries available, you can start your chaos engineering journey in minutes. Discover more and elevate your systems today! πŸ”πŸ’» #ChaosEngineering #DevOps...
Source: Red Hat Developer Blog
Tullio Sebastiani

Your agent, your rules: A deep dive into the Responses API with Llama Stack

2025-08-20 07:01
πŸ” The OpenAI Responses API simplifies AI application development by managing complex orchestration. However, it is tied to specific models and a proprietary cloud service. Enter Llama Stack, an open-source server that offers a compatible Responses API and lets you deploy on your hardware with your chosen models. It supports advanced features like Retrieval-augmented Generation (RAG) for accurate answers without compromising document privacy. Explore how Llama Stack can transform your AI...
Source: Red Hat Developer Blog
J William Murdock, Roland Huß, Ann Marie Fred

Build a container image for a Quarkus project using Buildpacks

2025-08-20 07:01
πŸš€ Learn how to build container images for your Quarkus projects using the Container Image Buildpack extension! This method eliminates the need for a Dockerfile, streamlining your CI/CD workflow. πŸ”§ The extension leverages the Java Buildpack Client to simplify application deployment in Kubernetes. Ensure you have Podman/Docker, JDK 21+, and Maven 3.9+ to get started. πŸ“¦ With just a few Maven commands, you can create, build, and push your images to container registries effortlessly. #Quarkus...
Source: Red Hat Developer Blog
Charles Moulliard, Ozzy Osborne

How I built an agentic application for Docling with MCP

2025-08-20 07:01
🌐 Exciting developments in AI with the Model Context Protocol (MCP) from Anthropic! Released in November 2024, MCP enables large language models to communicate seamlessly with various tools. πŸ› οΈ With thousands of open-source MCP servers available, many developers are now creating agentic applications. However, there's still untapped potential in fully utilizing MCP’s capabilities. πŸ“„ My journey began during my internship at Red Hat, where I worked with Docling, an open-source data preprocessor....
Source: Red Hat Developer Blog
Ryan Fernandes

Building trustworthy AI: A developer's guide to production-ready systems

2025-08-20 07:01
🌐 Building trustworthy AI is essential in today's development landscape. As AI engineers and developers, focusing on trust, safety, and transparency is crucial for creating reliable applications. πŸ” AI systems should be assessed based on their potential impact, categorized into high, moderate, and minimal tiers. This impacts design choices and operational guardrails. πŸ’‘ Best practices include documenting training data, testing for bias, ensuring explainability, and providing human...
Source: Red Hat Developer Blog
Maarten Vandeperre, Camille Nigon

Build on multi-arch clusters with builds for Red Hat OpenShift

2025-08-19 07:01
πŸš€ Discover how to streamline multi-arch builds with Red Hat OpenShift! This article explains the builds for Red Hat OpenShift operator, allowing you to create a single build object for mixed architecture clusters. Key steps include installing the oc client, configuring the ClusterBuildStrategy, and verifying image builds for different architectures. Learn more about simplifying your build process! #RedHat #OpenShift #MultiArch #CloudComputing #DevOps
Source: Red Hat Developer Blog
Dylan Orzel

How to enhance Agent2Agent (A2A) security

2025-08-19 07:01
πŸ”’ The Agent2Agent (A2A) protocol by Google facilitates communication between AI agents, allowing seamless interaction across different vendors. Each agent can serve as a client or remote agent depending on the context. 🌐 Communication involves retrieving an Agent Card, which contains essential details for task execution. Security measures such as HTTPS and authentication protocols are crucial for protecting these interactions. πŸ›‘οΈ Developers implementing A2A should remain vigilant about...
Source: Red Hat Developer Blog
Florencio Cano Gabarda

Getting started with llm-d for distributed AI inference

2025-08-19 07:01
🌐 As large language models (LLMs) evolve, so must their infrastructure. Introducing **llm-d**, a Kubernetes-native distributed inference stack designed to enhance AI applications. It optimizes for complex reasoning, long-running prompts, and modular scaling. Key features include smart load balancing, split-phase inference, and disaggregated caching for efficiency. This innovation addresses the unique challenges of LLM inference, making it more cost-effective and performant. Join the growing...
Source: Red Hat Developer Blog
Cedric Clyburn, Philip Hayes

Manage Advanced Cluster Management policies using Ansible

2025-08-14 07:01
Managing multiple Kubernetes clusters can be complex, especially with the need for consistent security and compliance. This article discusses how Red Hat Advanced Cluster Management simplifies this process through centralized management. Ansible automation enhances policy management by ensuring consistency, repeatability, and compliance across clusters. It also covers the use of the external secrets operator for secure credential management with AWS Secrets Manager. For more details, check...
Source: Red Hat Developer Blog
Amjed Jabari (AJ)

Integrate vLLM inference on macOS/iOS with Alamofire and Apple Foundation

2025-08-14 07:01
Unlock the potential of vLLM inference in your macOS/iOS apps! πŸ“±πŸ’» This article explores how to use Apple Foundation and Alamofire for seamless communication with vLLM via an OpenAI-compatible Chat Completions endpoint. It covers essential topics such as data encoding, error handling, and processing streaming results. For hands-on experience, grab the sample code from GitHub and start building! πŸš€πŸ”— #vLLM #macOS #iOSDevelopment #OpenAI #Alamofire
Source: Red Hat Developer Blog
Rich Naszcyniec