✨ News ✨

🎤 Presenting at VIS 2023 in Melbourne, AU

My paper, 'Dupo: A Mixed-Initiative Authoring Tool for Responsive Visualization,' is accepted at VIS 2023. I am also going to present at Doctoral Colloquium about multi-context data visualization design.


Hi, I'm Hyeok Kim (hjʌk). I'm a PhD candidate in Computer Science at Northwestern University. Currently, I work with Professor Jessica Hullman at MU Collective. Previously, I did my masters in Communication at Seoul National University with colleagues from HCI+D Lab.

My research interests include

  • 📊 data visualization,
  • 📱🖥 responsive visualization and multi-context visualization
  • 🛠 visualization system, formalization, and automation,
  • 📜 narrative and communicative visualization, and
  • 🧙🏻‍♂design research for societal problems.

If you are interested in these areas as well, feel free to contact me for collaboration 🙆🏻‍♂!

More background

I studied Linguistics for my undergraduate major, and Computational and Statistical Linguistics for my student-designed minor. Data visualization was my way to practice programming and statistics together—this was indeed a great approach and led me to various areas in HCI, including system design, visualization grammar, and design research. I am a first-generation PhD student.


I have led exciting research projects that are close to the domain fields and published papers on data visualization and design research in top HCI venues.

Responsive Visualization Authoring

Data visualization helps us to reason about various problems from daily decisions to professional judgment. We face more and more visualization use cases through diverse device types (mobile phones, desktops). To enable seamless support for visualizations on different devices, I have studied "responsive visualization," referring to adapting visualizations for different device types.

Authoring responsive visualizations is not easy because it is hard to manage multiple versions and every individual creators have a full set of relevant knowledge. Thus, I took a "mixed-initiative" (= automated recommendation + human customization) approach to support responsive visualization authoring. This took an extensive path: understanding current practices and tradeoffs, formalizing loss measures for preserving task-oriented insights between responsive versions, formalizing responsive transformations (Cicero grammar), and an interface for mixed-initiative responsive visualization authoring.

Dupo interface for manual authoring and recommendations

Hyeok Kim, Ryan Rossi, Jane Hoffswell, & Jessica Hullman. 2023. Dupo: A Mixed-initiative Authoring Tool for Responsive Visualization. IEEE VIS 2023. Preprint. Public Demo. Supplemental material. Video Demo.

JSON-based Cicero expressions for partially transposing and changing the row orders for a grouped bar chart.

Hyeok Kim, Ryan Rossi, Fan Du, Eunyee Koh, Shunan Guo, Jessica Hullman, & Jane Hoffswell. 2022. Cicero: A Declarative Grammar for Responsive Visualization. ACM CHI 2022. Preprint. Online gallery for Cicero grammar. Supplemental material.

Changes to task-oriented insights under responsive transformations. Identification: is this data point still identifiable? Approximated using difference in entropy of visual attributes. Comparison: Is this pair of data points similarly comparable? Approximated by Earth Mover's Distance between distributions of pairwise distances. Trend: Does this relationship between two variables appear similarly? Approximated by difference between LOESS-based trend estimates. Under a pipeline from a source view, candidate generation, ranking model to ranked output targets, these three approximations are applied to the ranking model part.

Hyeok Kim, Ryan Rossi, Abhraneel Sarma, Dominik Moritz, & Jessica Hullman. 2021. An Automated Approach to Reasoning About Task-Oriented Insights in Responsive Visualization. IEEE TVCG (VIS 2021). Preprint. Supplemental material.

nine responsive visualization design patterns for remove encoding, transpose axes, change encoding, disable hover interactions, change trigger, add GPS, fix tooltip position, remove trigger, and remove feedback.

Hyeok Kim, Dominik Moritz, & Jessica Hullman. 2021. Design patterns and trade-offs in responsive visualization for communication. Computer Graphics Forum (EUROVIS 2021). Preprint. Online gallery for responsive visualization. Supplemental material.

Design for Societal Problems

Designing for the underrepresented helps us to grow better as a community. My interest is bridging what underrepresented groups need to how a system—beyond user interface—is designed, implemented, and deployed.

Information System for Sexual Violence Survivors

Sexual violence survivors often have a hard time finding suitable support services due to various societal and personal constraints. While personalization is key to navigating a vast search space of support-seeking, how to personalize (i.e., how to ask for personalization and how to provide personalized information) has been less asked given its importance. To understand personalization in a conversational interaction setting, we conducted a co-design workshop with experts, implemented a high-fidelity prototype system, and interviewed self-identified sexual violence survivors.

A chatbot interface providing information about nearby support centers for sexual violence survivors and asking closed-input questions about topics a user is wondering.

Hyeok Kim, Youjin Hwang, Jieun Lee, Youngjin Kwon, Yujin Park, & Joonhwan Lee. 2022. Personalization Trade-offs in Designing a Dialogue-based Information System for Support-Seeking of Sexual Violence Survivors. ACM CHI 2022. Preprint. Supplemental material.

Design Guidelines for the In-game Sexual Harassment Prevention System

In online video games, sexual harassment against female gamers frequently occurs and becomes worse with various factors. This research project attempts to suggest design guidelines that both prevent harassment. A short paper on this project was published in HCI Korea 2018 Conference (extended abstract). Download Preprint (Korean)

Media-as-Place Storytelling

From escape rooms to Sara is Missing... and Searching..., we experience a new kind of narrative where their places seem identical to their media: real objects in escape rooms, a smartphone for Sara is Missing..., and a computer for Searching.... We shed light on this emerging storytelling technique by identifying it as 'Media-as-Place' storytelling. This approach will enhance place-based learning of HCI as well as enrich our digital narrative techniques.

The implementation of MiRO, a Media-as-Place computer game

This game demonstrates the idea of Media-as-Place storytelling. This work was presented at DIS 2019 Work-in-Progress track.

a screenshot of MiRO game

Hyeok Kim, Haesoo Kim, Youngjin Kwon, Hansol Jang, SooMin Lee, & Joonhwan Lee. 2019. ACM DIS Work-inProgress. Preprint. Game demo (English/Korean).


Data visualization projects

Explore them here!

Web development projects

SNU FactCheck

SNU FactCheck is a news portal that aggregates fact-checks from (initially) 27 media outlets. This is serviced by SNU Institue for Communication Research and collaborated with Naver. (link)

SNU Card NewsBot

SNU Card NewsBot is a robot journalism system that automatically generates personalized news slides. This was funded by Institute for Information and Communications Technology Promotion of South Korea. (link)


Utopia is a web app for energy education. My team developed user-side and content provider-side apps. The user-side app features an energy diary, webcomics with audio autoplay, and a book viewer system, and the content provider-side app offers functionalities to support those features. (link)




Email: hyeokkim2024 [at] u.northwestern.edu
Twitter: @hyeok__kim
Mastodon: vis.social/@hyeokkim