SlideShare a Scribd company logo
1 of 1
Download to read offline
Toward machines that behave ethically better than humans do
 Matthijs           Pontier 1, 2
                1                                                          Moral Goals      Belief strengths   Actions   Output
 Johan F, Hoorn




                                                         Moral reasoner
 1 VU                                                                                                             F
        University, Amsterdam                                                Autonomy
 2 http://camera-vu.nl/matthijs/
                                                                                                               Action1
   matthijspon@gmail.com

                                                                            Beneficence


                                                                                                               Action2
Abstract
Increasing dependence on autonomous                                       Non-maleficence
operating systems calls for ethical machine
behavior. Our moral reasoner combines
connectionism, utilitarianism, and ethical
theory about moral duties. The moral
decision-making matches the analysis of
expert ethicists in the health domain. This is
particularly useful when machines interact
with humans in a medical context. Connected
to a model of emotional intelligence and
affective decision making, we can explore
how moral decision making impacts affective
behavior and vice versa.



Background
Rosalind Picard (1997): ‘‘The greater the
freedom of a machine, the more it will need
moral standards.’’

Wallach, Franklin, and Allen (2010) argue
that agents that adhere to a deontological
ethic or that are utilitarians also require
emotional intelligence, a sense of self, and a
theory of mind.

We connected the moral system to Silicon
Coppélia (Hoorn, Pontier, & Siddiqui, 2011), a
model of emotional intelligence and affective
decision making. Silicon Coppélia contains a
feedback loop that learns the preferences of
an individual patient so to personalize its
behavior.



Results
                                                 Discussion
                                                 Sample Exp. 5: A patient with incurable cancer refuses chemotherapy to
                                                 live a few months longer, almost without pain, because he is convinced
                                                 of being cancer-free. According to Buchanan and Brock (1989), the
                                                 ethically preferable answer is to “try again.” The patient seems less than
                                                 fully autonomous and his decision leads to harm, denying the chance to
                                                 a longer life (a violation of the duty of beneficence). This he might regret
                                                 later. Our moral reasoner comes to the same conclusion as the ethical
                                                 experts. However, even among doctors, there is no consensus about the
                                                 interpretation of values, their ranking and meaning. Van Wynsberghe
                                                 (2012) found this depends on: the type of care (i.e., social vs. physical
                                                 care), the task (e.g., bathing vs. lifting vs. socializing), the care-givers
                                                 and their style, as well as the care-receivers and their specific needs.

More Related Content

Similar to Toward machines that behave ethically better than humans do - Poster

1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf
cronkwurphyb44502
 
Final Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docxFinal Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docx
AKHIL969626
 
1111298173 282415 7
1111298173 282415 71111298173 282415 7
1111298173 282415 7
dborcoman
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docxCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
tiffanyd4
 
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docxCHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
christinemaritza
 
SBCC Framework
SBCC FrameworkSBCC Framework
SBCC Framework
CChange
 
12. roy's theory
12. roy's theory12. roy's theory
12. roy's theory
Sukh Preet
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsourCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
TawnaDelatorrejs
 

Similar to Toward machines that behave ethically better than humans do - Poster (20)

MEDICAL ETHICS LECTURE 2022.pptx
MEDICAL ETHICS LECTURE 2022.pptxMEDICAL ETHICS LECTURE 2022.pptx
MEDICAL ETHICS LECTURE 2022.pptx
 
1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf
 
Final Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docxFinal Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docx
 
1111298173 282415 7
1111298173 282415 71111298173 282415 7
1111298173 282415 7
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docxCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
 
Callista Roy's Theory of Adaptation.ppt
Callista Roy's Theory of Adaptation.pptCallista Roy's Theory of Adaptation.ppt
Callista Roy's Theory of Adaptation.ppt
 
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docxCHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
 
SBCC Framework
SBCC FrameworkSBCC Framework
SBCC Framework
 
Alimohammadi Et Al.docx
Alimohammadi Et Al.docxAlimohammadi Et Al.docx
Alimohammadi Et Al.docx
 
Chapter4 ethical issues
Chapter4  ethical issuesChapter4  ethical issues
Chapter4 ethical issues
 
12-roystheory-130614111953-phpapp02.pdf
12-roystheory-130614111953-phpapp02.pdf12-roystheory-130614111953-phpapp02.pdf
12-roystheory-130614111953-phpapp02.pdf
 
12. roy's theory
12. roy's theory12. roy's theory
12. roy's theory
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsourCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
 
Chapter 7
Chapter  7Chapter  7
Chapter 7
 
Toward machines that behave ethically better than humans do
Toward machines that behave ethically better than humans doToward machines that behave ethically better than humans do
Toward machines that behave ethically better than humans do
 
THE ROY’S ADAPTATION MODEL OF NURSING.pptx
THE ROY’S ADAPTATION MODEL OF NURSING.pptxTHE ROY’S ADAPTATION MODEL OF NURSING.pptx
THE ROY’S ADAPTATION MODEL OF NURSING.pptx
 
Behaviour Change Communication.pptx
Behaviour Change Communication.pptxBehaviour Change Communication.pptx
Behaviour Change Communication.pptx
 
Introduction to bioethics
Introduction to bioethicsIntroduction to bioethics
Introduction to bioethics
 
BI-M2-CU7.pdf
BI-M2-CU7.pdfBI-M2-CU7.pdf
BI-M2-CU7.pdf
 
Common Theories.pptx
Common Theories.pptxCommon Theories.pptx
Common Theories.pptx
 

More from Matthijs Pontier

Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Matthijs Pontier
 
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Matthijs Pontier
 
Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09
Matthijs Pontier
 
Wie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvAWie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvA
Matthijs Pontier
 
Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...
Matthijs Pontier
 
How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...
Matthijs Pontier
 
Laat jij je meeslepen?
Laat jij je meeslepen?Laat jij je meeslepen?
Laat jij je meeslepen?
Matthijs Pontier
 
Encod jaarplan 2018
Encod jaarplan 2018Encod jaarplan 2018
Encod jaarplan 2018
Matthijs Pontier
 
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23 Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Matthijs Pontier
 
How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...
Matthijs Pontier
 
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
Matthijs Pontier
 
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Matthijs Pontier
 
Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt
Matthijs Pontier
 
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Matthijs Pontier
 
How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...
Matthijs Pontier
 
Geef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waardeGeef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waarde
Matthijs Pontier
 
Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?
Matthijs Pontier
 
Piratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheidPiratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheid
Matthijs Pontier
 

More from Matthijs Pontier (20)

Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
 
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
 
Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09
 
Wie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvAWie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvA
 
Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...
 
How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...
 
Laat jij je meeslepen?
Laat jij je meeslepen?Laat jij je meeslepen?
Laat jij je meeslepen?
 
Encod jaarplan 2018
Encod jaarplan 2018Encod jaarplan 2018
Encod jaarplan 2018
 
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23 Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
 
How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...
 
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
 
Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...
Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...
Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...
 
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
 
Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt
 
Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...
Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...
Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...
 
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
 
How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...
 
Geef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waardeGeef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waarde
 
Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?
 
Piratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheidPiratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheid
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 

Toward machines that behave ethically better than humans do - Poster

  • 1. Toward machines that behave ethically better than humans do Matthijs Pontier 1, 2 1 Moral Goals Belief strengths Actions Output Johan F, Hoorn Moral reasoner 1 VU F University, Amsterdam Autonomy 2 http://camera-vu.nl/matthijs/ Action1 matthijspon@gmail.com Beneficence Action2 Abstract Increasing dependence on autonomous Non-maleficence operating systems calls for ethical machine behavior. Our moral reasoner combines connectionism, utilitarianism, and ethical theory about moral duties. The moral decision-making matches the analysis of expert ethicists in the health domain. This is particularly useful when machines interact with humans in a medical context. Connected to a model of emotional intelligence and affective decision making, we can explore how moral decision making impacts affective behavior and vice versa. Background Rosalind Picard (1997): ‘‘The greater the freedom of a machine, the more it will need moral standards.’’ Wallach, Franklin, and Allen (2010) argue that agents that adhere to a deontological ethic or that are utilitarians also require emotional intelligence, a sense of self, and a theory of mind. We connected the moral system to Silicon Coppélia (Hoorn, Pontier, & Siddiqui, 2011), a model of emotional intelligence and affective decision making. Silicon Coppélia contains a feedback loop that learns the preferences of an individual patient so to personalize its behavior. Results Discussion Sample Exp. 5: A patient with incurable cancer refuses chemotherapy to live a few months longer, almost without pain, because he is convinced of being cancer-free. According to Buchanan and Brock (1989), the ethically preferable answer is to “try again.” The patient seems less than fully autonomous and his decision leads to harm, denying the chance to a longer life (a violation of the duty of beneficence). This he might regret later. Our moral reasoner comes to the same conclusion as the ethical experts. However, even among doctors, there is no consensus about the interpretation of values, their ranking and meaning. Van Wynsberghe (2012) found this depends on: the type of care (i.e., social vs. physical care), the task (e.g., bathing vs. lifting vs. socializing), the care-givers and their style, as well as the care-receivers and their specific needs.