T-Chip Group
Intelligent hardware website
Innovate intelligent hardware and solutions.
Server Business Website
Server products and efficient solutions.
Consumer Business Website
StationPC NAS products and services.

CSD2-N96 AI Server

96 Compute Nodes in Total

· Mainstream SoC Platform Support

· All-Module Hot-Swap Design

· Android Multi-Instance Support

· 80 Gbps Aggregate Peak Bandwidth

· Granular Network Security Control

· Smaller Single-Point Failure Impact Range

· 3 pcs of 3.5-inch SATA3.0 HDD/SSD

· Highly Integrated Server Design

Manual Wiki Download Community Docs

Gemma

Llama

Qwen

Stable Diffusion

CSD2-N96
CSD2-N96 AI Computing Server

CSD2-N96 features 12 built-in compute blades (96 compute nodes in total), with each node delivering 6-60 TOPS of computing power. Platform options include Qualcomm, Rockchip, SOPHGO and SpacemiT. It supports private deployment of mainstream AI large models and multiple deep learning frameworks. Equipped with 8 x 10GbE ports, achieving peak switch bandwidth of 80 Gbps. With standard 2U rackmount server chassis design, it also comes with intelligent BMC management system.

Mainstream SoC Platform Support

CSD2-N96 offers a wide range of AI processor options, including mainstream hardware platforms such as Qualcomm, Rockchip, SOPHGO, and SpacemiT, adapting to diverse computing scenarios.

All-Module Hot-Swap Design

The server adopts fully hot-swappable modular architecture, integrating BMC network modules, switch network modules, power modules, and 12 compute blade modules. Each compute blade is standardly equipped with 8 independent compute nodes, enabling high-density deployment of up to 96 compute nodes.

Android Multi-Instance Support

Adopts Android container-level isolated multi-instance architecture. Through lightweight virtualization scheduling mechanism, it efficiently reuses SoC hardware resources, significantly improving chip computing power and overall system resource utilization.

80 Gbps Aggregate Peak Bandwidth

Equipped with 8 x 10GbE SFP+ ports, delivering an aggregate peak bandwidth of up to 80 Gbps to meet high-bandwidth application requirements. An independent BMC management network interface separates the management network from the business network, ensuring secure and reliable network communication.

Granular Network Security Control

Supports granular dynamic network isolation between core modules, enabling flexible control of cross-board communication permissions. It also features network traffic control, bandwidth scheduling, and Layer 3 network policy configuration, allowing on-demand network domain partitioning and business traffic isolation to ensure comprehensive network communication security and data exchange reliability.

Smaller Failure Impact Range

Each compute blade module is equipped with 8 core boards. When a single core board fails, maintenance affects only its corresponding 8 compute nodes — significantly better than the industry norm of 16-20 affected nodes.

3 pcs of 3.5-inch SATA3.0 HDD/SSD

Features 3 pcs of 3.5-inch (or 2.5-inch) drive bay supporting SATA 3.0 HDD/SSD expansion, enabling seamless capacity scaling to terabyte-level storage. With hot-swappable capability for rapid drive replacement, it fulfills integrated deployment requirements for file management, data backup, video surveillance, and similar applications.

Efficient and Low-Cost

 CSD2-N96 highly integrates computing units, storage, USB controllers, network controllers, power management controllers, and sensors into a single system. It provides an all-in-one SDK for deep learning development, along with a suite of software tools including low-level drivers, compilers and inference deployment tools, reducing users' procurement, development and operational costs.
96 Computing Nodes, Powerful Performance

Fully configured system can deploy up to 96 compute nodes, with each node supporting 5-10 containers deployed in parallel based on business requirements. The entire system can virtualize and host 480-960 system containers, effectively revitalizing hardware resources and significantly improving overall resource utilization efficiency.

Application Scenarios

Widely applicable in industry fields such as Edge Computing, Large Model Localization, Smart City, Smart Healthcare, Smart Industry and Intelligent Security.

Edge Computing
Edge Computing
Private Deployment of Large Models
Private Deployment of Large Models
Smart City
Smart City
Smart Healthcare
Smart Healthcare
Smart Industry
Smart Industry
Intelligent Security
Intelligent Security
Interfaces
Specifications

CSD2-N96Q8550

CSD2-N96R3576

CSD2-N96R3588S

CSD2-N96SPK3

Technical Specifications

Server form

2U rack-mounted computing power server

Architecture

ARM architecture

RISC-V architecture

Number of nodes

12 compute blades (96 distributed compute nodes) + 1 control node

Compute nodes

Octa-core 64-bit processor Qualcomm QCS8550, up to 3.36GHz

Octa-core 64-bit processor RK3576, up to 2.2GHz

Octa-core 64-bit processor RK3588S, up to 2.4GHz

Octa-core 64-bit processor SpacemiT Key Stone K3, up to 2.4GHz

Video encoding

8K@30fps/4K@120fps H.264

H.264: 1×4K@60fps

H.264: 1×8K@30fps, 16×1080P@30fps

4K@90fps H.264

Video decoding

8K@60fps/4K@240fps H.264/VP9/AV1

1×4K@120fps (VP9,AVS2,AV1) 1×4K@60fps (H.264/AVC)

8K@60fps/4K@120fps (VP9/AVS2) 8K@30fps (H.264/AVC/MVC) 30×1080P@30fps (H.264)

4K@180fps H.264/VP9

Control nodes

Octa-core 64-bit processor RK3588, main frequency up to 2.4GHz, the highest computing power is 6TOPS

AI computing power

4608TOPS (48T × 96, INT8)

576TOPS (6T × 96, INT8)

5760TOPS (60T× 96, SquareINT4)

RAM

16GB LPDDR5X × 96

8GB LPDDR4/LPDDR5 × 96 (4/8/16GB)

16GB LPDDR5 × 96 (4/8/16/32GB)

32GB LPDDR5 × 96 (8/16/32GB)

Storage

256GB UFS4.0 × 96

64GB eMMC × 96 (16/32/64/128/256GB)

256GB eMMC × 96 (16/32/64/128/256GB)

128GB UFS2.2 × 96

Storage expansion

3.5-inch/2.5-inch SATA3.0 SSD hard drive slot × 3 (Supports hot swapping; BMC can directly operate the hard drive, and computing child nodes can indirectly access the hard drive through the network sharing method provided by BMC)

Power

2 × 1300W hot-swappable power supplies, 1+1 redundancy support

Fan module

14 high-speed cooling fans

Physical Specifications

Size

Standard 2U rack servers: 495.60mm × 928.51mm × 88.80mm

Installation requirements

IEC 297 Universal Cabinet Installation: 19 inches wide and 800 mm deep and above Retractable slideway installation: The distance between the front and rear holes of the cabinet is 543.5mm~848.5mm

Environment

Operating Temperature: 0ºC ~ 30ºC, Storage Temperature: -40ºC ~ 60ºC, Operating Humidity: 5% ~ 80%RH (non-condensing)

Software Specifications

BMC

The BMC management system is integrated with the web-based management interface, supporting Redfish, VNC, NTP, monitoring advanced and virtual media, and the BMC management system can be redeveloped

Large language models

All models support private deployment of ultra-large-scale parameter models under the Transformer architecture, such as large language models including Deepseek-R1 Series, Gemma Series, Llama Series, ChatGLM Series, Qwen Series, Phi Series, etc.

Visual large model

K3: Supports private deployment of all vision large models QCS8550: Supports private deployment of vision large models including Qwen2.5-VL, InternVL3, etc.

AI Painting

K3: Supports private deployment of all image generation models QCS8550: Supports private deployment of the Stable Diffusion image generation model

Deep learning

All models: Support traditional network architectures such as CNN, RNN, LSTM, and support various deep learning frameworks such as TensorFlow, PyTorch, PaddlePaddle, ONNX, and Caffe. Support custom operator development and Docker containerization management technology

Interface Specifications

Internet

8 × 10Gbps SFP+, 1 × Gigabit Ethernet (RJ45, MGMT is used as BMC management network)

Console

1 × Console (RJ45, BMC debug serial port, baud rate 115200)

Display

1 × VGA (maximum resolution 1080P, BMC management display)

USB

3 × USB3.0, 1 × Type-C (OTG)

Button

1 × Power, 1 × UID, 1 × Recovery, 1 × Reset
Customization

Firefly team, with over 20 years of experience in product design, research and development, and production, provides you with services such as hardware, software, complete machine customization, and OEM server.

Hardware Solution

Software Solution

Turnkey Solution