Articles from Source: Red-Hat-Developer-Blog

Run cost-effective AI workloads on OpenShift with AWS Neuron Operator

2025-12-02 16:30
πŸš€ Enhance your AI workloads with the AWS Neuron Operator on Red Hat OpenShift! This collaboration allows enterprises to run LLM inference and training with AWS Inferentia and Trainium chips, offering up to 70% lower costs per inference. The AWS Neuron Operator simplifies deployment and management of AI devices, optimizing performance and cost efficiency. Key features include automated scheduling, device management, and telemetry collection. Gain flexibility and significant savings while...
Source: Red Hat Developer Blog
Erwan Gallen, Yevgeny Shnaidman, Nenad Peric

Automate unique compliance checks with OpenShift and CustomRule

2025-12-02 08:00
Unlock enhanced compliance for Red Hat OpenShift with the new CustomRule feature! πŸš€ This article reveals how security teams can automate unique compliance checks, transforming specific security rules into code. It offers practical examples on writing and integrating CustomRules into existing workflows, streamlining the auditing process. Currently in Tech Preview, this feature is designed to help organizations maintain compliance efficiently. Explore more about CustomRules and their potential!...
Source: Red Hat Developer Blog
Vincent Shen, Lance Bragstad

Build custom OS images for IBM Power systems (ppc64le) with bootc

2025-12-02 07:01
πŸš€ Developers and system admins can now streamline OS image creation for IBM Power systems using bootc! This guide explains how to build reproducible, container-native OS images efficiently. Bootc allows you to convert OCI container images into bootable OS images, enhancing speed and consistency. Key steps include setting up your ppc64le builder machine, installing necessary tools, and defining your custom image. For detailed instructions, check the full article! πŸ–₯οΈπŸ”§ #IBMCloud #PowerSystems...
Source: Red Hat Developer Blog
Manish Kumar

Generate synthetic data for your AI models with SDG Hub

2025-12-02 07:01
Unlock the potential of your AI models with SDG Hub! πŸš€ This open-source framework transforms minimal quality data into extensive synthetic datasets. It utilizes modular blocks to create automated pipelines that generate, validate, and scale data while keeping sensitive information secure. πŸ”’ Developers can enhance model training efficiency with tailored synthetic data, making the process faster and more cost-effective. Explore the step-by-step guide to get started with SDG Hub and create high-...
Source: Red Hat Developer Blog
Legare Kerrison, Frank La Vigne

What you need to know about Red Hat's .NET container images

2025-12-01 15:30
πŸš€ Red Hat offers .NET container images under the Universal Base Image (UBI) license, allowing free use and redistribution without a subscription. πŸ”’ These images feature strong security practices, including CVE monitoring and detailed software bill of materials (SBOMs). Enterprise support is available on Red Hat platforms, with community support for others. πŸ–₯️ Images cater to various architectures, including IBM Z and Power Systems, and include separate repositories for the .NET SDK, ASP.NET...
Source: Red Hat Developer Blog
Tom Deseyn

How to set up Red Hat Lightspeed Model Context Protocol

2025-12-01 08:00
πŸ” Red Hat Lightspeed (formerly Red Hat Insights) enhances operational efficiency with proactive analytics. The new Model Context Protocol (MCP) allows AI to interact with services using natural language. This feature simplifies incident response by providing immediate answers to queries about alerts, such as CVEs. The article provides a step-by-step guide on setting up the insights-mcp service, including creating service accounts, assigning roles, and deploying the server. For more details,...
Source: Red Hat Developer Blog
Samiksha Saxena

Lift and shift a .NET application to OpenShift

2025-12-01 07:15
πŸš€ Looking to migrate a .NET application? Consider the lift-and-shift approach on Red Hat OpenShift. This method allows you to move applications with minimal code changes, making it a practical first step towards modernization. The article details the process of containerizing an e-commerce app using a Containerfile and highlights key considerations for deployment. Key points include using the Red Hat .NET 9.0 SDK image and setting up security best practices for non-root users. For those...
Source: Red Hat Developer Blog
Kevin Chung, Sam Foreman

Run Ruby applications in FIPS mode on Red Hat Enterprise Linux

2025-11-28 07:15
πŸ”’ Interested in running Ruby applications in FIPS mode on Red Hat Enterprise Linux? This article provides clear guidance on how to achieve this. It explains the necessary versions of RHEL and Ruby, with a focus on Ruby OpenSSL support. Learn how to confirm your FIPS environment and handle cryptographic algorithms properly. For more details, check out the full article! #Ruby #FIPS #RedHat #Cybersecurity #OpenSSL
Source: Red Hat Developer Blog
Jun Aruga

Use NetApp to run SAP on OpenShift Virtualization with a dual boot on bare metal

2025-11-27 07:01
πŸš€ In complex enterprise environments, migrating virtual workloads to physical hardware can be challenging. This article highlights how Red Hat OpenShift Virtualization, NetApp Trident, and FlexClone tech can streamline this process. πŸ”§ It explains configuring OpenShift, installing NetApp Trident, and creating bootable LUNs for physical servers. This enables rapid migration and testing for applications like SAP HANA, ensuring consistent performance across platforms. For detailed steps on...
Source: Red Hat Developer Blog
Nils Koenig, Prerna Mohta

How does cgroups v2 impact Java and Node.js in OpenShift 4?

2025-11-27 07:01
Understanding the impact of cgroups v2 on Java and Node.js in OpenShift 4 is essential for developers. This article outlines compatibility concerns and solutions associated with cgroups v2, a Linux kernel feature for resource management in containers. It details how different OpenShift versions handle cgroups, emphasizing the importance of using the latest images for Node.js and OpenJDK. For those using Java, cgroups v2 compatibility was introduced in OpenJDK 8u372 and later versions. Node.js...
Source: Red Hat Developer Blog
Francisco De Melo Junior

How to enable NVIDIA GPU acceleration in OpenShift Local

2025-11-27 07:00
Unlock the power of NVIDIA GPU acceleration in OpenShift Local! πŸ–₯️✨ This article details the steps to share an NVIDIA GPU with OpenShift Local for AI and ML workloads, enhancing your local development experience. Key topics include GPU passthrough configuration, BIOS adjustments, and validating your setup. Explore how to optimize your environment to run intensive applications without needing a dedicated server. #OpenShift #NVIDIA #GPU #AI #MachineLearning
Source: Red Hat Developer Blog
Alexander Barbosa Ayala , Francisco De Melo Junior

Trusted execution clusters operator: Design and flow overview

2025-11-26 08:01
πŸ”’ Confidential computing enhances cloud-native security by protecting data in use, which is traditionally vulnerable. The trusted execution cluster operator, a Kubernetes-native tool, manages clusters with hardware-based security features like secure enclaves and memory encryption. This ensures that sensitive workloads are accessed only by verified software. Key components include the Trustee for attestation and key management, and the operator automates the configuration of security...
Source: Red Hat Developer Blog
Alice Frosi, Jakob Naucke

Autoscaling vLLM with OpenShift AI model serving: Performance validation

2025-11-26 07:01
πŸš€ Exciting insights on autoscaling with vLLM in OpenShift AI! This article compares KServe's KEDA-based autoscaling to Knative's concurrency-based approach. Key findings show KEDA's ability to scale effectively under both homogeneous and heterogeneous workloads, maintaining service-level objectives (SLO) better than Knative. πŸ” KEDA adapts to real-time metrics, ensuring efficient resource use and improved request success rates. Dive deeper into the performance results and implications for AI...
Source: Red Hat Developer Blog
Alberto Perdomo

Introducing Models-as-a-Service in OpenShift AI

2025-11-25 07:00
πŸš€ Exciting news for AI enthusiasts! Red Hat has introduced Models-as-a-Service (MaaS) in OpenShift, currently in developer preview. MaaS allows organizations to deploy and manage AI models as shared resources, enhancing accessibility and scalability. This new feature offers standardized API endpoints for efficient model sharing. πŸ”§ Setup is straightforward with a single deployment script. Users can also test sample models and experience rate limiting to ensure quality of service. For detailed...
Source: Red Hat Developer Blog
Dmytro Zaharnytskyi

Building domain-specific LLMs with synthetic data and SDG Hub

2025-11-25 07:00
🌐 Synthetic data generation is transforming how we build large language models (LLMs). By using one model to create training examples for another, teams can fill domain-specific gaps without relying on scarce human data. πŸ”§ Enter SDG Hub, an open-source toolkit that simplifies synthetic data workflows. It allows users to mix LLM components with traditional data tools, enhancing efficiency and scalability. πŸ“ˆ The process includes generating synthetic data, fine-tuning models, and deploying...
Source: Red Hat Developer Blog
Shivchander Sudalairaj, Hao Wang, Addie Stevens

External IP visibility in Red Hat Advanced Cluster Security

2025-11-24 08:01
πŸ” Red Hat Advanced Cluster Security for Kubernetes 4.8 has launched with new features, including external IP visibility. This capability helps security teams identify external IP addresses used by their deployments, improving awareness of network connections. 🌐 The update also includes OpenShift infrastructure compliance and enhanced vulnerability advisories. These tools aid in detecting and managing threats, particularly from potential malware and command-and-control activities. πŸ”§ For setup,...
Source: Red Hat Developer Blog
Shane Boulden

How I used Red Hat Lightspeed image builder to create CIS (and more) compliant images

2025-11-24 07:00
Creating compliant images just got easier with Red Hat Lightspeed! πŸš€ As a Technical Marketing Manager, I discovered that building RHEL systems for regulatory compliance was time-consuming. After switching to Red Hat Lightspeed image builder, I streamlined the process significantly. Now, I can create CIS-compliant images quickly through an intuitive wizard. This tool simplifies compliance with various regulatory policies and frameworks, cutting down hours of work to just minutes. ⏱️ Interested...
Source: Red Hat Developer Blog
John Spinks

Building a oversaturation detector with iterative error analysis

2025-11-24 07:00
πŸš€ Excited to share insights from our recent work on building an oversaturation detector (OSD) using iterative error analysis! We began with a baseline algorithm that struggled with false alerts due to erratic initial data. By ignoring the first 25% of requests, we significantly reduced these errors. Next, we added a 30-second grace period to differentiate good runs from bad ones during the early shoot-up phase. Finally, we established a rule to alert only when both response time and request...
Source: Red Hat Developer Blog
Alon Kellner

Introduction to distributed inference with llm-d

2025-11-21 07:01
πŸš€ Distributed inference is revolutionizing the deployment of large language models (LLMs). This approach enhances efficiency across diverse infrastructures by utilizing Kubernetes and Red Hat OpenShift. πŸ” The article highlights the evolution of distributed inference and introduces the open-source project, llm-d, which optimizes LLM performance through disaggregated inference and intelligent scheduling. πŸ“Š Key innovations include separating model execution components, prompt-aware routing, and...
Source: Red Hat Developer Blog
Christopher Nuland, Addie Stevens

How to build your dynamic plug-ins for Developer Hub

2025-11-20 08:01
πŸš€ Red Hat Developer Hub supports dynamic plug-ins, allowing you to enhance your portal without recompiling the core application. This system offers key benefits: - Immutable design for better security - Easy plug-in management - Flexible customization options - Faster feature innovation Learn how to bundle and install your own plug-ins with Developer Hub! #RedHat #DeveloperHub #DynamicPlugins #Backstage #SoftwareDevelopment
Source: Red Hat Developer Blog
Evan Shortiss

Defining success: Evaluation metrics and data augmentation for oversaturation detection

2025-11-20 07:01
Oversaturation in benchmarking large language models (LLMs) can waste time and resources. To tackle this issue, we developed an algorithm that accurately detects oversaturation while preserving valid tests. Our new metric, the Soft-C-Index, prioritizes not just the order of alerts but also the time saved, ensuring efficiency. Next, we will explore algorithm improvements and error analysis. #DataScience #MachineLearning #LLM #Oversaturation #Innovation πŸš€πŸ“ŠπŸ’‘
Source: Red Hat Developer Blog
Alon Kellner

Deploying OpenShift hosted clusters on bare metal

2025-11-19 08:17
Deploying Red Hat OpenShift hosted clusters on bare metal offers significant infrastructure efficiency. Here are five key lessons learned from practical experience: 1️⃣ **Network Setup is Crucial**: Proper network configuration is essential for stability. Pay attention to link aggregation protocols for optimal performance. 2️⃣ **API Access via IP**: Access the Kube API using a raw IP address instead of a domain name to avoid certificate errors. 3️⃣ **Manual Ingress Setup**: Unlike traditional...
Source: Red Hat Developer Blog
Andre Rocha

Get started with language model post-training using Training Hub

2025-11-19 07:15
Unlock the potential of open-source language models with Training Hub! πŸš€ This library simplifies post-training by providing a unified Python interface for various algorithms, making it easier to customize models for specific tasks. Training Hub supports a variety of methods, allowing seamless integration and exploration of different libraries without the hassle of complex setups. Get started today and enhance your language model capabilities! πŸ“ˆπŸ’» #LanguageModels #OpenSource #AI...
Source: Red Hat Developer Blog
Mustafa Eyceoz

Speculators: Standardized, production-ready speculative decoding

2025-11-19 07:15
πŸš€ Speculative decoding is changing the game for large language models (LLMs) by improving inference speed! A small speculator model predicts multiple tokens efficiently, while a larger verifier model confirms them in one pass. This can lead to speed improvements of 1.5 to 2.5 times, especially under low request rates. Challenges remain, including a lack of standard formats and production-ready algorithms. The newly released Speculators v0.2.0 aims to address these issues with a standardized...
Source: Red Hat Developer Blog
Alexandre Marques, Dipika Sikka, Eldar Kurtić, Fynn Schmitt-Ulms, Helen Zhao, Megan Flynn, Rahul Tuli, Mark Kurtz

The strategic choice: Making sense of LLM customization

2025-11-18 14:16
Unlocking the potential of Large Language Models (LLMs) starts with effective prompting. πŸ€– Out-of-the-box models may provide accurate responses, but they often lack your brand’s voice and tone. Customization, particularly through prompt engineering, is crucial for aligning the model with your organization's needs. Prompting shapes conversations and helps refine the model's reasoning. By structuring prompts effectively, you can transform these models into proactive collaborators. Learn more...
Source: Red Hat Developer Blog
Robbie Jerrom, Frank La Vigne

Building the digital substation: Exploring the LF Energy SEAPATH architecture on Red Hat Enterprise Linux

2025-11-18 08:01
🌐 The LF Energy SEAPATH project on Red Hat Enterprise Linux is revolutionizing electrical substation automation. By utilizing open source technologies, SEAPATH aims to enhance the integration of IT and OT for improved system reliability and cybersecurity. πŸ”§ Key components include a real-time Linux kernel, KVM for virtualization, and Ceph for distributed storage. This architecture supports software-defined protection, automation, and control in digital substations. πŸ“ˆ With a focus on open...
Source: Red Hat Developer Blog
Daniel J. Schaefer

How to run performance tests using benchmark-runner

2025-11-18 08:01
🌐 Performance testing is essential for Kubernetes and Red Hat OpenShift clusters, especially when scaling applications across pods or VMs. πŸ” The benchmark-runner framework allows users to execute various performance tests to assess scalability in hardware, network, storage, and more. It simplifies testing with just a single command and supports both functional and performance-oriented run types. πŸ“Š Results are stored in ElasticSearch and visualized in Grafana, making it easier for cluster...
Source: Red Hat Developer Blog
Robert Krawitz, Jenifer Abrams, Guoqing Li

Reduce LLM benchmarking costs with oversaturation detection

2025-11-18 07:01
Exploring large language model (LLM) performance is complex and costly. A recent article highlights the challenges faced by a team at Red Hat in benchmarking 7,488 combinations of models and hardware. They encountered a significant issue known as oversaturation, which invalidated over half of their tests. This led to the development of an oversaturation detection (OSD) strategy to improve efficiency. Their testing relied on a three-part stack: vLLM for inference, GuideLLM for real-world load...
Source: Red Hat Developer Blog
Alon Kellner

.NET 10 is now available for RHEL and OpenShift

2025-11-17 15:20
πŸš€ .NET 10 is now available for Red Hat Enterprise Linux (RHEL) and OpenShift! This release includes support for C# 14 and F# 10, improved performance in the base library, and new Post-Quantum Cryptography APIs. Developers can install .NET 10 using the command: `dnf install dotnet-sdk-10.0`. It offers long-term support until November 2028. #DotNet10 #RHEL #OpenShift #SoftwareDevelopment #RedHat
Source: Red Hat Developer Blog
Tom Deseyn, Brian Gollaher

Image mode for RHEL 10: Updates in seconds with soft reboot

2025-11-17 08:00
πŸš€ Exciting news for RHEL 10 users! The new image mode feature introduces a soft reboot capability, allowing for faster updates without the need for a full system reboot. This method improves OS management, reducing downtime from minutes to seconds for userspace updates. The soft reboot skips lengthy hardware initialization steps, making it ideal for critical infrastructure. However, it's important to note that kernel updates still require a full reboot. Explore this advancement to enhance...
Source: Red Hat Developer Blog
Mohan Shash, Joseph Marrero Corchado

What’s new in Red Hat build of Apache Camel 4.14

2025-11-14 16:56
πŸš€ The Red Hat build of Apache Camel 4.14 introduces an enhanced integration toolkit for hybrid environments. Key updates include support for OpenSearch, Azure Data Lake Storage, and Mail Microsoft OAuth. πŸ” Developers will benefit from productivity boosts with the Kaoto integration designer, which now supports visual data mapping for JSON and XML. πŸ“Š Additionally, a new Camel dashboard provides real-time insights into integration health on Red Hat OpenShift, while the HawtIO Artemis Plugin...
Source: Red Hat Developer Blog
Ivo Bek

Red Hat Enterprise Linux 9.7: Top features for developers

2025-11-12 20:02
πŸš€ Red Hat Enterprise Linux (RHEL) 9.7 is now available, bringing many enhancements for developers! Key updates include the latest versions of Rust, GCC Toolset, LLVM, and Go compilers, all aimed at improving development speed and efficiency. Notable features are the new Rust 2024 Edition and improved performance in Go 1.24. RHEL 9.7 also introduces post-quantum cryptography for enhanced security, a locally available AI command-line assistant, and reproducible container image builds. Explore...
Source: Red Hat Developer Blog
Brian Gollaher

Red Hat Enterprise Linux 10.1: Top features for developers

2025-11-12 19:19
πŸš€ Red Hat Enterprise Linux (RHEL) 10.1 is now available! This release enhances developer tools and introduces new features for efficient application development. Key updates include: - Vendor-validated AI accelerator drivers for better AI integration. - Soft-reboot capability to reduce downtime during updates. - Reproducible builds for container tools, ensuring identical images. Developers can also access the latest versions of Rust, GCC, LLVM, and Go compilers for improved performance....
Source: Red Hat Developer Blog
Brian Gollaher

New in MicroShift 4.20: The generic device plug-in

2025-11-12 14:00
πŸš€ Exciting news for edge computing! MicroShift 4.20 introduces a generic device plug-in, enhancing access to devices like serial ports and cameras from Kubernetes pods. This feature simplifies secure connections without granting full host access, reducing security risks. Devices are defined in the configuration, allowing for flexible resource management. For detailed steps on implementation, check the product documentation! πŸ–₯οΈπŸ”Œ #MicroShift #Kubernetes #EdgeComputing #RedHat #DevOps
Source: Red Hat Developer Blog
Daniel Froehlich, Kasturi Narra

Exhaustive profiling toolkit: elfutils and libdwfl_stacktrace

2025-11-12 08:01
The article explores advancements in Linux stack profiling through elfutils and the new libdwfl_stacktrace initiative. It highlights how these tools aim to provide exhaustive profiling solutions, focusing on system-wide stack sample profiling without needing frame pointers. The libdwfl_stacktrace interface offers improved functionality for interacting with various profiling tools. Additionally, the article discusses the SFrame project as a lightweight alternative, although it faces challenges...
Source: Red Hat Developer Blog
Serhei Makarov

What’s new for developers in Red Hat OpenShift 4.20

2025-11-11 14:01
πŸš€ Red Hat OpenShift 4.20 is now available! This release features enhancements for developers, including multicluster support and improved AI capabilities. πŸ”§ Key updates include a streamlined Red Hat Developer Hub, new tools in Podman Desktop, and expanded support in OpenShift Dev Spaces. Developers can now efficiently manage multiple clusters and access the latest AI models. πŸ“Š New observability tools and infrastructure optimizations are also part of this update, enhancing overall performance....
Source: Red Hat Developer Blog
Shannon Madden

Introducing the external secrets operator for OpenShift

2025-11-11 08:00
πŸš€ The external secrets operator (ESO) for Red Hat OpenShift is now generally available. This operator enhances secrets management, complementing tools like cert-manager and secrets store CSI operator. πŸ” ESO automates the management of Kubernetes secrets, improving security by allowing DevSecOps teams to manage credentials from a centralized source. πŸ“š For more insights on secrets management in OpenShift, check out Red Hat's learning path. #RedHat #OpenShift #SecretsManagement #DevSecOps...
Source: Red Hat Developer Blog
Bharath B, Nick Png

OpenShift AI connector for Red Hat Developer Hub (Developer Preview)

2025-11-10 12:15
πŸš€ Exciting updates for developers! The new OpenShift AI connector for Red Hat Developer Hub allows seamless integration, automatically transferring AI model metadata into the Software Catalog. This enhancement streamlines the development process by providing a unified view of AI infrastructure and resources. Key features include dynamic plug-ins and sidecar containers that help manage AI model metadata directly from OpenShift AI. Explore the details in the latest article. #OpenShift #RedHat...
Source: Red Hat Developer Blog
Gabe Montero

MCP in Red Hat Developer Hub: Chat with your catalog

2025-11-10 12:15
πŸš€ Exciting updates for Red Hat Developer Hub! New plug-ins for Model Context Protocol (MCP) are now available starting with version 1.8. These tools enable MCP clients to interact with the software catalog and retrieve TechDocs documentation. πŸ” The Red Hat Developer Hub centralizes development resources, enhancing productivity. The MCP server allows for seamless connection between AI models and external tools. For installation and configuration details, check out the article! #RedHat...
Source: Red Hat Developer Blog
John Collier

How to develop Red Hat Enterprise Linux applications on other Linux distributions or Microsoft Windows

2025-11-10 07:00
Developing applications for Red Hat Enterprise Linux (RHEL) can be done effectively on various platforms, including other Linux distributions and Microsoft Windows. One approach is using Toolbx on Linux, which creates a native command-line environment within a container. This allows developers to run RHEL applications seamlessly across different Linux versions. Alternatively, on Windows, the Windows Subsystem for Linux (WSL) enables a full Linux experience, integrating tools from both...
Source: Red Hat Developer Blog
Louis Imershein