ARui's Blog

This post is a step-by-step tutorial on compiling PyTorch models for AWS Neuron (Inf2) chips, focusing on BlipForQuestionAnswering. It covers model wrapping, tracing, inference, and practical code examples for deployment.

This post shares my thoughts on the first semester (Fall 2023) of my master’s program at NYCU CS, covering courses like Operating Systems, Seminar, Network Security, and more — including content, grading, and personal reflections.

This post explains the differences between HTTP-based APIs (REST, polling, streaming, SSE) and WebSocket APIs, using analogies and code samples to illustrate communication models and protocol upgrades.