Victor Augusto Kich | <strong>Intelligent Robot Laboratory</strong><br />University of Tsukuba

About Me

I am an M.Eng. student at the University of Tsukuba, specializing in deep reinforcement learning, computer vision, and robotics. Under the supervision of Prof. Akihisa Ohya and co-supervision of Prof. Ayano Yorozu, my research focuses on developing advanced algorithms for state representation learning and their applications in autonomous systems. I am passionate about exploring the intersection of artificial intelligence and robotics, aiming to contribute to innovative research that advances the capabilities of intelligent agents.

Research Interests

Reinforcement Learning: policy learning, model-based, curriculum learning
Deep Learning state representation, world modeling, contrastive learning
Simulation: high-fidelity simulation, human-robot interation
Robotics: terrestrial mobile robot, unmanned aerial vehicle, quadruped and bipedal robots

News

[Sep. 2024] Our paper about High-Fidelity Procedural Simulations was presented at RO-MAN 2024, California, United States of America.
[Aug. 2024] Our paper about Kolmogorov-Arnold Networks was accepted to ICCAS 2024, Jeju, South Korea.
[Aug. 2024] Our paper about Parallel Distributional Deep Reinforcement Learning was accepted to ICCAS 2024, Jeju, South Korea.
[Aug. 2024] Our paper about Contrastive Representations for World Modeling was accepted to ICCAS 2024, Jeju, South Korea.
[Aug. 2024] Our paper about YOLOv5 and YOLOv8 in Dynamic Robotic Environments was presented at CIS-RAM 2024, Hangzhou, China.
[Aug. 2024] Our paper about Dataset for Weed Detection in Soy Crops via Instance Segmentation was presented at CIS-RAM 2024, Hangzhou, China.

Publications

ICCAS

Kolmogorov-Arnold Network for Online Reinforcement Learning

Victor Augusto Kich, Jair Augusto Bottega, Raul Steinmetz, Junior Costa de Jesus, Ricardo Bedin Grando, Ayanori Yorozu, Akihisa Ohya

24th International Conference on Control, Automation and Systems (ICCAS), 2024.

PDF Code Early Accept

ICCAS

Parallel Distributional Deep Reinforcement Learning for Mapless Navigation of Terrestrial Mobile Robots

Victor Augusto Kich, Alisson Henrique Kolling, Junior Costa de Jesus, Gabriel Vinicius Heisler, Hiago Jacobs, Jair Augusto Bottega, Andre L. da S. Kelbouscas, Akihisa Ohya, Ricardo Bedin Grando, Paulo L. J. Drews-Jr, Daniel Fernando Tello Gamarra

24th International Conference on Control, Automation and Systems (ICCAS), 2024.

PDF Code Video Early Accept

ICCAS

CURLing the Dream: Contrastive Representations for World Modeling in Reinforcement Learning

Victor Augusto Kich, Jair Augusto Bottega, Raul Steinmetz, Junior Costa de Jesus, Ricardo Bedin Grando, Ayanori Yorozu, Akihisa Ohya

24th International Conference on Control, Automation and Systems (ICCAS), 2024.

PDF Code Early Accept

RO-MAN

Advancing Behavior Generation in Mobile Robotics through High-Fidelity Procedural Simulations

Victor Augusto Kich, Jair Augusto Bottega, Raul Steinmetz, Ricardo Grando, Ayanori Yorozu, Akihisa Ohya

33rd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2024.

PDF Code Early Accept

JIRS

Image-based Mapless Navigation of a Hybrid Aerial-Underwater Vehicle using Prioritized Deep Reinforcement Learning

Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Jair Augusto Bottega, Ricardo Bedin Grando, Rodrigo da Silva Guerra, Paulo Lilles Jorge Drews

Journal of Intelligent & Robotic Systems (JIRS), 2024.

Code Early Accept

JIRS

Parallel Deep Reinforcement Learning for Hybrid Mobile Robots

Ricardo Grando, Raul Steinmetz, Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Rodrigo da Silva Guerra, Paulo L. J. Drews-Jr

Journal of Intelligent & Robotic Systems (JIRS), 2024.

Code Video Early Accept

CASE

Improving Generalization in Aerial and Terrestrial Mobile Robots Control Through Delayed Policy Learning

Ricardo Grando, Raul Steinmetz, Victor Augusto Kich, Alisson Henrique Kolling, Pablo Ezequiel Moraes Furik, Junior Costa de Jesus, Bruna de Vargas Guterres, Daniel Fernando Tello Gamarra, Rodrigo da Silva Guerra, Paulo Drews-Jr

20th IEEE International Conference on Automation Science and Engineering (CASE), 2024.

PDF Early Accept

CIS

Precision and Adaptability of YOLOv5 and YOLOv8 in Dynamic Robotic Environments

Victor Augusto Kich, Muhammad A. Muttaqien, Junya Toyama, Ryutaro Miyoshi, Yosuke Ida, Akihisa Ohya, Hisashi Date

11th IEEE International Conference on Cybernetics and Intelligent Systems (CIS), 2024.

PDF Code Oral Presentation

CIS

From Seedling to Harvest: The GrowingSoy Dataset for Weed Detection in Soy Crops via Instance Segmentation

Raul Steinmetz, Victor Augusto Kich, Henrique Krever, Joao Davi Rigo Mazzarolo, Ricardo Grando, Vinicius Marini, Celio Trois, Ard Nieuwenhuizen

11th IEEE International Conference on Cybernetics and Intelligent Systems (CIS), 2024.

PDF Code Video Oral Presentation

JIFS

Delta robot control by learning systems: Harnessing the power of deep reinforcement learning algorithms

Matheus dos Santos Lima, Victor Augusto Kich, Raul Steinmetz, Daniel Fernando Tello Gamarra

Journal of Intelligent & Fuzzy Systems (JIFS), 2024.

PDF Code Video Published

LARS

DoCRL: Double Critic Deep Reinforcement Learning for Mapless Navigation of a Hybrid Aerial Underwater Vehicle with Medium Transition

Ricardo B Grando, Junior C De Jesus, Victor Augusto Kich, Alisson H Kolling, Matheus G Mateus, Rodrigo S Guerra, Paulo LJ Drews

Latin American Robotics Symposium (LARS), 2023.

PDF Code Video Oral Presentation

LARS

Parallel Distributional Prioritized Deep Reinforcement Learning for Unmanned Aerial Vehicles

Alisson Henrique Kolling, Victor Augusto Kich, Junior Costa de Jesus, Andressa Cavalcante Da Silva, Ricardo Bedin Grando, Paulo Lilles Jorge Drews, Daniel FT Gamarra

Latin American Robotics Symposium (LARS), 2023.

PDF Oral Presentation

LARS

Enhanced Low-Dimensional Sensing Mapless Navigation of Terrestrial Mobile Robots Using Double Deep Reinforcement Learning Techniques

Linda Dotto de Moraes, Victor Augusto Kich, Alisson Henrique Kolling, Jair Augusto Bottega, Ricardo Bedin Grando, Anselmo Rafael Cukla, Daniel Fernando Tello Gamarra

Latin American Robotics Symposium (LARS), 2023.

PDF Video Oral Presentation

JIRS

Jubileo: An Immersive Simulation Framework for Social Robot Design

Jair Augusto Bottega, Victor Augusto Kich, Junior Costa de Jesus, Raul Steinmetz, Alisson Henrique Kolling, Ricardo Bedin Grando, Rodrigo da Silva Guerra, Daniel Fernando Tello Gamarra

Journal of Intelligent & Robotic Systems (JIRS), 2023.

PDF Code Video Published

ISDA

Double Deep Reinforcement Learning Techniques for Low Dimensional Sensing Mapless Navigation of Terrestrial Mobile Robots

Linda D de Moraes, Victor Augusto Kich, Alisson Henrique Kolling, Jair Augusto Bottega, Raul Steinmetz, Emerson C da Silva, Ricardo Bedin Grando, Anselmo Rafael Cukla, Daniel Fernando Tello Gamarra

Intelligent Systems Design and Applications (ISDA), 2023.

PDF Published

Undergraduate Thesis

Aprendizado por reforço profundo distribucional paralelo para navegação sem mapa de robôs móveis terrestres

Victor Augusto Kich

Federal University of Santa Maria Repository, 2023.

PDF Undergraduate Thesis, in Portuguese

JIRS

Double Critic Deep Reinforcement Learning for Mapless 3D Navigation of Unmanned Aerial Vehicles

Ricardo Bedin Grando, Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Paulo Lilles Jorge Drews-Jr

Journal of Intelligent & Robotic Systems (JIRS), 2022.

PDF Code Video Published

MOBILWARE

Bibliographic Analysis of the Capacity and Applicability of Li-Fi Networks

Kelvin I. Seibt, Victor Augusto Kich, Gabriel V. Heisler

Mobile Wireless Middleware, Operating Systems and Applications (MOBILWARE), 2022.

PDF Oral Presentation

LARS

Virtual Reality Platform to Develop and Test Applications on Human-Robot Social Interaction

Jair Augusto Bottega, Raul Steinmetz, Alisson Henrique Kolling, Victor Augusto Kich, Junior Costa de Jesus, Ricardo Bedin Grando, Daniel Fernando Tello Gamarra

Latin American Robotics Symposium (LARS), 2022.

PDF Oral Presentation

IROS

Depth-cuprl: Depth-imaged Contrastive Unsupervised Prioritized Representations in Reinforcement Learning for Mapless Navigation of Unmanned Aerial Vehicles

Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Ricardo Bedin Grando, Rodrigo da Silva Guerra, Paulo Lilles Jorge Drews

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022.

PDF Code Video Oral Presentation

LARS

Deterministic and Stochastic Analysis of Deep Reinforcement Learning for Low Dimensional Sensing-based Navigation of Mobile Robots

Ricardo Bedin Grando, Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Pedro M Pinheiro, Rodrigo da Silva Guerra, Paulo Lilles Jorge Drews

Latin American Robotics Symposium (LARS), 2022.

PDF Oral Presentation

LARS

Mapless Navigation of a Hybrid Aerial Underwater Vehicle with Deep Reinforcement Learning Through Environmental Generalization

Ricardo Bedin Grando, Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Pedro M Pinheiro, Rodrigo da Silva Guerra, Paulo Lilles Jorge Drews

Latin American Robotics Symposium (LARS), 2022.

PDF Oral Presentation

Humanoids

Jubileo: An Open-Source Robot and Framework for Research in Human-Robot Social Interaction

Jair A Bottega, Victor Augusto Kich, Alisson Henrique Kolling, Jardel Dyonisio, Pedro Corçaque, Rodrigo da Silva Guerra, Daniel Fernando Tello Gamarra

IEEE-RAS 21st International Conference on Humanoid Robots (Humanoids), 2022.

PDF Code Video Oral Presentation

ICRA

Deep Reinforcement Learning for Mapless Navigation of a Hybrid Aerial Underwater Vehicle with Medium Transition

Ricardo B Grando, Junior C de Jesus, Victor Augusto Kich, Alisson H Kolling, Nicolas P Bortoluzzi, Pedro M Pinheiro, Armando A Neto, Paulo LJ Drews

IEEE International Conference on Robotics and Automation (ICRA), 2021.

PDF Code Video Oral Presentation

JIRS

Soft Actor-Critic for Navigation of Mobile Robots

Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Ricardo Bedin Grando, Marco Antonio de Souza Leite Cuadros, Daniel Fernando Tello Gamarra

Journal of Intelligent & Robotic Systems (JIRS), 2021.

PDF Code Published

SBGames

Deep Reinforcement Learning Using a Low-Dimensional Observation Filter for Visual Complex Video Game Playing

Victor Augusto Kich, Junior Costa de Jesus, Ricardo Bedin Grando, Alisson Henrique Kolling, Gabriel Vinicius Heisler, Rodrigo da Silva Guerra

Brazilian Symposium on Computer Games and Digital Entertainment (SBGames), 2021.

PDF Code Video Oral Presentation

BRAHUR

Antagonistic Torsion Spiral Springs Variable Stiffness Actuator - ATOSS VSA

David Roy Richards, Victor Augusto Kich, Rodrigo da Silva Guerra

III Brazilian Humanoid Robot Workshop (BRAHUR), 2020.

PDF Oral Presentation