Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process

Rida Gillani; Ali Nasir

doi:10.1109/INTELSE.2016.7475168

Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process

Rida Gillani
, Ali Nasir

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

8 Scopus citations

Abstract

There are many challenges involved in the realization of a shopping assistance robot (SAR). The specific challenge addressed in this paper is that of incorporating artificial intelligence or decision making capability in such robot. Markov Decision Process (MDP) based formulation of the problem has been presented for this purpose. The major advantage of the MDP based approach over simple search based artificial intelligence techniques is that it can incorporate uncertainty. The proposed MDP model has been solved for optimal policy using value iteration algorithm. Furthermore, it has been shown how the reward function influences the structure of the resulting policy. The results show encouraging potential in the use of MDP based formulation for SAR.

Original language	English
Title of host publication	2016 International Conference on Intelligent Systems Engineering, ICISE 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	94-99
Number of pages	6
ISBN (Electronic)	9781467387521
DOIs	https://doi.org/10.1109/INTELSE.2016.7475168
State	Published - 19 May 2016
Externally published	Yes
Event	International Conference on Intelligent Systems Engineering, ICISE 2016 - Islamabad, Pakistan Duration: 15 Jan 2016 → 17 Jan 2016

Publication series

Name	2016 International Conference on Intelligent Systems Engineering, ICISE 2016

Conference

Conference	International Conference on Intelligent Systems Engineering, ICISE 2016
Country/Territory	Pakistan
City	Islamabad
Period	15/01/16 → 17/01/16

Bibliographical note

Publisher Copyright:
© 2016 IEEE.

Keywords

Markov decision processes
decision making
optimality
reward function
shopping robot

ASJC Scopus subject areas

Artificial Intelligence
Computer Networks and Communications
Signal Processing
Control and Systems Engineering
Instrumentation

Access to Document

10.1109/INTELSE.2016.7475168

Cite this

Gillani, R., & Nasir, A. (2016). Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process. In 2016 International Conference on Intelligent Systems Engineering, ICISE 2016 (pp. 94-99). Article 7475168 (2016 International Conference on Intelligent Systems Engineering, ICISE 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INTELSE.2016.7475168

@inproceedings{b41ddbd6297f45b480e7b0330a398974,

title = "Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process",

abstract = "There are many challenges involved in the realization of a shopping assistance robot (SAR). The specific challenge addressed in this paper is that of incorporating artificial intelligence or decision making capability in such robot. Markov Decision Process (MDP) based formulation of the problem has been presented for this purpose. The major advantage of the MDP based approach over simple search based artificial intelligence techniques is that it can incorporate uncertainty. The proposed MDP model has been solved for optimal policy using value iteration algorithm. Furthermore, it has been shown how the reward function influences the structure of the resulting policy. The results show encouraging potential in the use of MDP based formulation for SAR.",

keywords = "Markov decision processes, decision making, optimality, reward function, shopping robot",

author = "Rida Gillani and Ali Nasir",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; International Conference on Intelligent Systems Engineering, ICISE 2016 ; Conference date: 15-01-2016 Through 17-01-2016",

year = "2016",

month = may,

day = "19",

doi = "10.1109/INTELSE.2016.7475168",

language = "English",

series = "2016 International Conference on Intelligent Systems Engineering, ICISE 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "94--99",

booktitle = "2016 International Conference on Intelligent Systems Engineering, ICISE 2016",

address = "United States",

}

Gillani, R & Nasir, A 2016, Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process. in 2016 International Conference on Intelligent Systems Engineering, ICISE 2016., 7475168, 2016 International Conference on Intelligent Systems Engineering, ICISE 2016, Institute of Electrical and Electronics Engineers Inc., pp. 94-99, International Conference on Intelligent Systems Engineering, ICISE 2016, Islamabad, Pakistan, 15/01/16. https://doi.org/10.1109/INTELSE.2016.7475168

Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process. / Gillani, Rida; Nasir, Ali.
2016 International Conference on Intelligent Systems Engineering, ICISE 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 94-99 7475168 (2016 International Conference on Intelligent Systems Engineering, ICISE 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process

AU - Gillani, Rida

AU - Nasir, Ali

PY - 2016/5/19

Y1 - 2016/5/19

N2 - There are many challenges involved in the realization of a shopping assistance robot (SAR). The specific challenge addressed in this paper is that of incorporating artificial intelligence or decision making capability in such robot. Markov Decision Process (MDP) based formulation of the problem has been presented for this purpose. The major advantage of the MDP based approach over simple search based artificial intelligence techniques is that it can incorporate uncertainty. The proposed MDP model has been solved for optimal policy using value iteration algorithm. Furthermore, it has been shown how the reward function influences the structure of the resulting policy. The results show encouraging potential in the use of MDP based formulation for SAR.

AB - There are many challenges involved in the realization of a shopping assistance robot (SAR). The specific challenge addressed in this paper is that of incorporating artificial intelligence or decision making capability in such robot. Markov Decision Process (MDP) based formulation of the problem has been presented for this purpose. The major advantage of the MDP based approach over simple search based artificial intelligence techniques is that it can incorporate uncertainty. The proposed MDP model has been solved for optimal policy using value iteration algorithm. Furthermore, it has been shown how the reward function influences the structure of the resulting policy. The results show encouraging potential in the use of MDP based formulation for SAR.

KW - Markov decision processes

KW - decision making

KW - optimality

KW - reward function

KW - shopping robot

UR - https://www.scopus.com/pages/publications/84974555430

U2 - 10.1109/INTELSE.2016.7475168

DO - 10.1109/INTELSE.2016.7475168

M3 - Conference contribution

AN - SCOPUS:84974555430

T3 - 2016 International Conference on Intelligent Systems Engineering, ICISE 2016

SP - 94

EP - 99

BT - 2016 International Conference on Intelligent Systems Engineering, ICISE 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - International Conference on Intelligent Systems Engineering, ICISE 2016

Y2 - 15 January 2016 through 17 January 2016

ER -

Gillani R, Nasir A. Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process. In 2016 International Conference on Intelligent Systems Engineering, ICISE 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 94-99. 7475168. (2016 International Conference on Intelligent Systems Engineering, ICISE 2016). doi: 10.1109/INTELSE.2016.7475168

Incorporating artificial intelligence in shopping assistance robot using Markov Decision Process

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Fingerprint

Cite this