AIware 2024
Mon 15 - Tue 16 July 2024 Porto de Galinhas, Brazil, Brazil
co-located with FSE 2024
Mon 15 Jul 2024 14:00 - 14:20 at Mandacaru - Industry Talk2 + Human AI Conversation Chair(s): Qinghua Lu

Frontier Large language models in 2024 are capable of performing numerous tasks, including SE ones, and are widely used to create impressive demos. However, productizing these models remains notoriously challenging.

JetBrains AI Assistant is one such product, a developer tool, that provides IDE users with over 10 different features backed by latest LLMs. It supports various programming languages and is shipped in a number of different IDE products (IntelliJ, Rider, PyCharm, Goland, PhpStorm, etc).

In this session we will share the story of deploying LLM-based features to production over the past year developing AI Assistant: technical successes, challenges, and capabilities we believe LLMs pre-trained on code are still lacking in the SE context, from the perspective of an industrial developer tools vendor.

Mon 15 Jul

Displayed time zone: Brasilia, Distrito Federal, Brazil change

14:00 - 15:30
Industry Talk2 + Human AI ConversationMain Track / Industry Statements and Demo Track at Mandacaru
Chair(s): Qinghua Lu Data61, CSIRO
14:00
20m
Industry talk
AI Assistant in JetBrains IDE: Insights and Challenges
Industry Statements and Demo Track
Andrey Sokolov JetBrains Research
14:20
10m
Paper
Unveiling the Potential of a Conversational Agent in Developer Support: Insights from Mozilla’s PDF.js Project
Main Track
João Correia PUC-Rio, Morgan C. Nicholson University of São Paulo, Daniel Coutinho Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Caio Barbosa Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Marco Castelluccio Mozilla, Marco Gerosa Northern Arizona University, Alessandro Garcia Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Igor Steinmacher Northern Arizona University
DOI Pre-print
14:30
10m
Paper
From Human-to-Human to Human-to-Bot Conversations in Software Engineering
Main Track
Ranim Khojah Chalmers | University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers | University of Gothenburg, Philipp Leitner Chalmers | University of Gothenburg
DOI Pre-print
14:40
10m
Paper
RUBICON: Rubric-Based Evaluation of Domain-Specific Human AI Conversations
Main Track
Param Biyani Microsoft, Yasharth Bajpai Microsoft, Arjun Radhakrishna Microsoft, Gustavo Soares Microsoft, Sumit Gulwani Microsoft
DOI
14:50
5m
Paper
Unveiling Assumptions: Exploring the Decisions of AI Chatbots and Human Testers
Main Track
Francisco Gomes de Oliveira Neto Chalmers | University of Gothenburg
DOI
14:55
35m
Live Q&A
Session Q&A and topic discussions
Main Track