NEW AI Accelerated NUC with 16 Cores from ASRock

ServeTheHome
25 Apr 202419:57

TLDRThe ASRock Industrial NUC BOX-155H is a mini PC with a 16-core Intel Core Ultra 7 Series processor, supporting up to 96 GB of DDR5 memory and two SSDs. It features advanced connectivity with Wi-Fi, dual 2.5 Gig Ethernet, and Thunderbolt 4 ports. The system also includes an onboard NPU for AI inference, making it suitable for AI development and applications. Despite its compact size, the NUC BOX-155H offers robust performance, with the ability to handle gaming at 4K resolution and support for out-of-band management via Intel vPro. However, the system's thermal design may concentrate heat in areas without active cooling, which could be a concern. The unit's power consumption is moderate, with options to adjust performance settings in BIOS for different use cases. While not the most silent system, the NUC BOX-155H provides a good balance of performance, features, and size for those looking for a versatile mini PC with AI capabilities.

Takeaways

  • 💻 **ASRock Industrial NUC with 16 Cores**: The ASRock Industrial NUC features a 16-core Intel Core Ultra 7 Series processor, offering significant computing power in a compact form factor.
  • 🚀 **Memory and Storage**: The system supports up to 96 GB of DDR5 memory and has room for two SSDs, providing ample space for data and applications.
  • 🔌 **Connectivity**: Equipped with Wi-Fi, dual 2.5 Gig Ethernet, and Thunderbolt 4 support, the NUC offers high-speed data transfer and versatile connectivity options.
  • 🔬 **Onboard NPU for AI**: A notable feature is the onboard Neural Processing Unit (NPU) for AI inference, enhancing the system's capability to handle AI-related tasks.
  • 🌟 **Design and Cooling**: The NUC has a passive cooling design with thermal pads to cool components effectively, although the lack of a fan at the bottom could concentrate heat in certain areas.
  • 🖥️ **Display Outputs**: With four display outputs, including two HDMI 2.1 ports, the system is capable of driving multiple high-resolution displays.
  • 💡 **Intel vPro Support**: The presence of Intel vPro allows for remote management capabilities, making it suitable for use in scenarios that require out-of-band management.
  • 🔩 **Easy Access for Upgrades**: The system is designed for easy access to internals with just four screws, facilitating upgrades and maintenance.
  • 📡 **Wi-Fi Performance**: The Wi-Fi 6E module, while a high-end feature, exhibited some performance issues in certain environments compared to other systems.
  • 🎮 **Gaming Performance**: The system provided a playable gaming experience at 4K resolution in a tested game, indicating its multimedia capabilities.
  • 🛡️ **Power and Noise Trade-offs**: Performance mode increases power consumption and noise levels significantly, offering a trade-off between quiet operation and maximum performance.

Q & A

  • What are the main features of the ASRock industrial Nook box 155h?

    -The ASRock industrial Nook box 155h features a 16-core Intel Core Ultra 7 Series processor, supports up to 96 GB of DDR5 memory, has multiple USB ports including USB 3.2 Gen 2 and USB Type-C with Thunderbolt 4, offers dual 2.5 Gigabit Ethernet ports, and includes an onboard AI neural processing unit (NPU) for AI inference tasks.

  • What types of connectivity does the ASRock industrial Nook box 155h support?

    -It supports Wi-Fi 6E, dual 2.5 Gigabit Ethernet ports, Thunderbolt 4, USB 4, and has multiple display outputs including HDMI 2.1 and DisplayPort outputs through USB Type-C.

  • How does the ASRock industrial Nook box 155h manage cooling for its components?

    -The system uses thermal pads to help cool its components, including M.2 SSDs and DDR5 memory modules. The design includes a passively cooled chassis with additional vents for heat dissipation.

  • Can the ASRock industrial Nook box 155h be used as a server?

    -Yes, with features like vPro for out-of-band management via its Ethernet ports and robust connectivity options, the ASRock industrial Nook box 155h can be configured as a server, making it suitable for light server tasks and network storage solutions.

  • What is the capacity and functionality of the storage solutions in the ASRock industrial Nook box 155h?

    -The system supports two M.2 SSDs and has the option to add a 2.5 inch SATA SSD. It also offers high-speed PCI Gen 4 interfaces for the M.2 SSDs, allowing for fast data transfer rates.

  • What improvements does the Intel Core Ultra 7 Series processor bring to the ASRock industrial Nook box 155h?

    -The Intel Core Ultra 7 Series processor, specifically the 155h model, enhances the system with higher core counts, advanced AI capabilities through its NPU, and improved memory speeds up to DDR5 5600, providing a significant performance boost over previous generations.

  • How does the AI functionality in the ASRock industrial Nook box 155h work?

    -The system includes an onboard NPU dedicated to AI tasks. It uses the ACK AI Guru software to facilitate AI inferencing, supporting applications like face detection through hardware-accelerated processing, thereby offloading these tasks from the CPU and GPU.

  • What are the power consumption and noise levels of the ASRock industrial Nook box 155h?

    -The power consumption varies with usage, from about 8 watts at idle up to 70 watts under load. Noise levels are generally low, around 36-37 dBA in normal mode, but can increase significantly in performance mode due to higher fan speeds.

  • How does the ASRock industrial Nook box 155h perform in gaming and general CPU-intensive tasks?

    -The system is capable of handling CPU-intensive tasks effectively and offers a decent gaming experience at 4K resolution with games like League of Legends, achieving frame rates between 60 and 100 FPS.

  • What are the BIOS customization options available for the ASRock industrial Nook box 155h?

    -The BIOS of the ASRock industrial Nook box 155h allows users to adjust power consumption limits, performance settings, and other operational parameters to suit different needs and preferences, enhancing flexibility for various use cases.

Outlines

00:00

🖥️ ASRock Industrial Nook siiz PC Overview

Patrick from St reviews the ASRock Industrial Nook siiz PC, a mini PC with a 16-core Intel Core Ultra 7 Series processor, support for up to 96 GB of memory, two SSDs, Wi-Fi, dual 2.5 gig Ethernet, and Thunderbolt devices. It also features an onboard NPU for AI inference. The unit was sent for review by ASRock Industrial and comes with passive cooling and a 4x4 Nook form factor. The front includes a power button and USB ports, while the back provides multiple display outputs and a DC Barrel Jack input. The system is designed for those looking for a compact, powerful, and feature-rich mini PC.

05:02

🔍 Inside the ASRock Nook siiz PC

The video dives into the internal features of the ASRock Nook siiz PC. It highlights the thermal pads for cooling components, the option to install a 2.5-inch SSD, and the presence of an Intel ax 211 Wi-Fi 6E module. The system supports DDR5 SODIMM memory up to 5600MT/s, with the capability to reach 96 GB. The Bare Bones configuration is discussed, along with the system's support for PCI Gen 4 M.2 SSDs and m.2 2242 slots for Intel VMD RAID support. The processor's performance is briefly touched upon, referencing the Meteor Lake H architecture for more information.

10:03

🤖 NPU and GPU Performance in AI Tasks

The video showcases the performance of the NPU and GPU in the ASRock Nook siiz PC. It demonstrates the use of the NPU for AI inference tasks, such as face detection, using the ASRock AI Guru software with OpenVINO. The NPU operates at about 50% utilization during the task, allowing the GPU to be used for other tasks. The video also includes a gaming performance test with League of Legends at 4K resolution, achieving playable frame rates between 60 and 100 FPS. Power consumption and noise levels are discussed, with the system's idle power consumption being reasonable, but noise levels increasing under load.

15:04

🛠️ Customization and Power Management

The video concludes with a discussion on the system's power management and customization options. It explains that users can adjust BIOS settings for power consumption and performance according to their needs. The system's performance mode is highlighted, which increases power consumption and noise levels for maximum performance. The narrator shares personal preferences, suggesting that the balanced mode is preferable for most users due to the lower noise level. The video wraps up with key lessons learned, emphasizing the system's suitability as a development box for AI and NPU applications and its value in accessing the latest features and performance improvements.

Mindmap

Keywords

💡NUC

A NUC, or Next Unit of Computing, is a small form factor PC designed by Intel. In the context of the video, it refers to a compact and powerful PC that is equipped with advanced features like a 16-core processor and AI capabilities. The NUC mentioned is from ASRock, a company known for its computer hardware products.

💡16-core processor

A 16-core processor is a CPU that has 16 individual cores, each capable of processing a separate thread of instructions. This allows for high performance in multi-threaded applications and multitasking. In the video, the NUC has a 16-core processor which is a key feature that enables it to handle demanding tasks efficiently.

💡DDR5 SODIMM

DDR5 SODIMM refers to a type of memory module that uses DDR5 memory technology. DDR5 is the latest generation of memory and offers higher performance than its predecessors. In the video, the NUC supports DDR5 SODIMMs, allowing for up to 96 GB of memory, which is significant for handling data-intensive applications.

💡AI inference

AI inference is the process of applying a trained machine learning model to new data to make predictions or decisions. The video discusses an onboard NPU (Neural Processing Unit) that is used for AI inference, highlighting the NUC's capability to perform advanced AI-related tasks efficiently.

💡Thunderbolt 4

Thunderbolt 4 is a hardware interface that allows for high-speed data transfer and connection of peripherals to a computer. It supports high-resolution displays and fast charging. The video mentions a USB Type-C port that doubles as a Thunderbolt 4 port, indicating the NUC's ability to connect to a wide range of devices and displays.

💡2.5 Gig Ethernet

2.5 Gig Ethernet refers to an Ethernet connection that supports speeds of up to 2.5 Gbps (Gigabits per second). The video highlights that the NUC has two 2.5 Gig Ethernet ports, which is a significant feature for users who require high-speed network connectivity for tasks like data transfer or online gaming.

💡Intel Core Ultra 7 Series

The Intel Core Ultra 7 Series is a line of high-performance processors from Intel. The '155h' model mentioned in the video is part of this series and is designed to deliver excellent performance for demanding applications. It is a key component that contributes to the NUC's overall capabilities.

💡Meteor Lake H

Meteor Lake H refers to a future generation of Intel CPUs, which are expected to offer improved performance and efficiency. The video discusses the Intel Core Ultra 7 Series processor in the context of Meteor Lake H architecture, indicating that the NUC is built with advanced and future-proof technology.

💡Wi-Fi 6E

Wi-Fi 6E is an extension of Wi-Fi 6 that operates in the 6 GHz band, providing faster speeds, lower latency, and less congestion. The video mentions an Intel AX211 Wi-Fi module, which is a Wi-Fi 6E module, suggesting that the NUC supports the latest wireless standards for enhanced wireless connectivity.

💡M.2 2280

M.2 2280 is a specification for an M.2 form factor solid-state drive (SSD), where the numbers 2280 indicate the dimensions of the SSD in millimeters (22 mm wide and 80 mm long). The video discusses the presence of an M.2 2280 slot, which allows the NUC to accommodate high-speed SSDs for storage.

💡vPro

Intel vPro is a suite of computer hardware and software technologies from Intel that provides advanced management and security capabilities for business PCs. The video mentions that the NUC has vPro support, allowing for out-of-band management and advanced security features, which are beneficial for enterprise environments.

Highlights

The ASRock Industrial NUC boasts a 16-core Intel Core Ultra 7 Series processor.

Supports up to 96 GB of DDR5 memory.

Can accommodate two SSDs for storage.

Includes Wi-Fi, dual 2.5 Gig Ethernet, and Thunderbolt 4 support.

Features an onboard NPU for AI inference.

The design allows for passive cooling.

Equipped with USB 3.2 Gen 2 and USB 4 ports for high-speed data transfer.

Four display outputs, including two HDMI 2.1 ports.

Intel vPro support for remote management.

The system's power adapter is relatively large compared to the unit itself.

Efficient thermal design with thermal pads for key components.

Supports expansion with a 2.5-inch SATA drive.

Integrated Intel AX211 Wi-Fi 6E module.

DDR5 SODIMM slots support up to DDR5 5600 memory.

Demonstrated AI inference using the NPU for face detection.

Gaming performance at 4K resolution in League of Legends was smooth.

Power consumption is moderate with idle at around 7-8 watts and load at approximately 28 watts.

Noise levels are noticeable but not overly disruptive in a quiet environment.

Performance mode increases power consumption and noise for higher performance.

ASRock's AI Guru software simplifies AI development with pre-packaged applications.