Modeling motorcycle's maneuver using Markov decision process with a dynamical discretized reward field in urban scenarios

Mardiati, Rina and Trilaksono, Bambang R. and Wibowo, Sony Sulaksoni and Laila, Dina Shona (2021) Modeling motorcycle's maneuver using Markov decision process with a dynamical discretized reward field in urban scenarios. International Journal of Automotive Technology, 22 (4). pp. 967-977. ISSN 1229-9138/1976-3832

[img]
Preview
Text
Rinas_Paper-final_170421-2_IJAT (1).pdf - Published Version

Download (977kB) | Preview
Official URL: http://www.ijat.net/journal/view.php?number=2069

Abstract

This paper proposes a novel MDP framework to deal with the accuracy of the motorcycle driving model. It proposes a weighted and unweighted Dynamical-Discretized Reward Field (DDRF) as a major contribution on modeling motorcycle maneuver in mixed traffic conditions. Other contributions of this work are the integration of a motorcycle trajectory maneuver model in the state transition function, derivation of probability functions, area of awareness (AoA) and its sectorization to perceive vehicles inside the AoA, which is used to determine actions. We conducted some simulations to evaluate the performance of the proposed model by comparing the data from the simulations with real data. In this study, we use 100 simulation data on motorcycle maneuvering, which consisted of two different scenarios, i.e., 50 data of motorcycle maneuvering to avoid other motorcycles and 50 data of motorcycle maneuvering to avoid cars. We adjusted the simulation setting to the real situation and measured the performance of the proposed model using root mean square error (RMSE). In general, the proposed method can properly model the maneuver of motorcycles in heterogeneous traffic with an RMSE value of around 0.74 meters. This model performs twice as good as an existing car-following model. Furthermore, the proposed reward function performs around 4~6% better than the reward function in previous studies.

Item Type: Article
Uncontrolled Keywords: Markov Decision Process; Motorcycle; Reward function; Driving behavior model
Subjects: Technology, Applied Sciences
Divisions: Fakultas Sains dan Teknologi > Program Studi Teknik Elektro
Depositing User: Rina Mardiati
Date Deposited: 09 May 2023 07:56
Last Modified: 23 May 2023 04:17
URI: https://digilib.uinsgd.ac.id/id/eprint/67331

Actions (login required)

View Item View Item