Jae Hyung Ju

ECE PhD Student at Georgia Tech

Email: jhju [at] gatech [dot] edu

About

I am a first-year Electrical and Computer Engineering PhD student at Georgia Tech. I am currently exploring memory system optimizations for LLM.

I received my BS from Seoul National University, where I was advised by Prof. Jung Ho Ahn on accelerating ML within Fully Homomorphic Encryption, and by Prof. Jinho Lee on designing a DRAM function-in-memory for efficient graph processing.

You can view my CV here.

Education

  • 2024–Current Georgia Institute of Technology, Atlanta, United States
    PhD in Electrical and Computer Engineering

  • 2018–2024 Seoul National University (SNU), Seoul, South Korea
    BS in Electrical and Computer Engineering

Work Experience

CryptoLab Inc.

Research Intern

Apr 2024 - Jul 2024

  • Designed and implemented the initial structure of a new Fully Homomorphic Encryption (FHE) library, with a focus on enabling easy integration of existing/future optimizations. (C++, CUDA)
  • Optimized the latency of Llama2 and ResNet18 within FHE.

Publications

  • Neujeans: Private Neural Network Inference with Joint Optimization of Convolution and FHE Bootstrapping
    *Jae Hyung Ju, *Jaiyoung Park, Jongmin Kim, Minsik Kang, Donghwan Kim, Jung Hee Cheon, and Jung Ho Ahn (*equal contribution)
    ACM Conference on Computer and Communications Security (CCS), 2024

  • A Case for In-Memory Random Scatter-Gather for Fast Graph Processing
    Changmin Shin, Taehee Kwon, Jaeyong Song, Jae Hyung Ju, Frank Liu, Yeonkyu Choi, and Jinho Lee
    IEEE Computer Architecture Letters (CAL), 2024

  • Piccolo: Large-scale graph processing with fine-grained in-memory scatter-gather
    Changmin Shin, Jaeyong Song, Hongsun Jang, Dogeun Kim, Jun Sung, Taehee Kwon, Jae Hyung Ju, Frank Liu, Yeonkyu Choi, and Jinho Lee
    IEEE International Symposium on High-Performance Computer Architecture (HPCA), 2025