default search action
Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCIDLora Aroyo
Person information
- affiliation: Google Research, USA
- affiliation (former): VU University Amsterdam, Computer Science Department, Netherlands
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
showing all ?? records
2020 – today
- 2024
[c139]Jessica Quaye
, Alicia Parrish, Oana Inel, Charvi Rastogi, Hannah Rose Kirk, Minsuk Kahng, Erin Van Liemt, Max Bartolo, Jess Tsang, Justin White, Nathan Clement, Rafael Mosquera, Juan Ciro, Vijay Janapa Reddi, Lora Aroyo:
Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation. FAccT 2024: 388-406- [c138]Vinodkumar Prabhakaran, Christopher Homan, Lora Aroyo, Aida Mostafazadeh Davani, Alicia Parrish, Alex S. Taylor, Mark Diaz, Ding Wang, Gregory Serapio-García:
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives. NAACL-HLT 2024: 3473-3492 - [i30]Jessica Quaye, Alicia Parrish, Oana Inel, Charvi Rastogi, Hannah Rose Kirk, Minsuk Kahng, Erin Van Liemt, Max Bartolo, Jess Tsang, Justin White, Nathan Clement, Rafael Mosquera, Juan Ciro, Vijay Janapa Reddi, Lora Aroyo:
Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation. CoRR abs/2403.12075 (2024) - [i29]Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, Victor Akinwande, Namir Al-Nuaimi, Najla Alfaraj, Elie Alhajjar, Lora Aroyo, Trupti Bavalatti, Borhane Blili-Hamelin, Kurt D. Bollacker, Rishi Bomassani, Marisa Ferrara Boston, Siméon Campos, Kal Chakra, Canyu Chen, Cody Coleman, Zacharie Delpierre Coudert, Leon Derczynski, Debojyoti Dutta, Ian Eisenberg, James Ezick, Heather Frase, Brian Fuller, Ram Gandikota, Agasthya Gangavarapu, Ananya Gangavarapu, James Gealy, Rajat Ghosh, James Goel, Usman Gohar, Subhra S. Goswami, Scott A. Hale, Wiebke Hutiri, Joseph Marvin Imperial, Surgan Jandial, Nick Judd, Felix Juefei-Xu, Foutse Khomh, Bhavya Kailkhura, Hannah Rose Kirk, Kevin Klyman, Chris Knotz, Michael Kuchnik, Shachi H. Kumar, Chris Lengerich, Bo Li, Zeyi Liao, Eileen Peters Long, Victor Lu, Yifan Mai, Priyanka Mary Mammen, Kelvin Manyeki, Sean McGregor, Virendra Mehta, Shafee Mohammed, Emanuel Moss, Lama Nachman, Dinesh Jinenhally Naganna, Amin Nikanjam, Besmira Nushi, Luis Oala, Iftach Orr, Alicia Parrish, Cigdem Patlak, William Pietri, Forough Poursabzi-Sangdeh, Eleonora Presani, Fabrizio Puletti, Paul Röttger, Saurav Sahay, Tim Santos, Nino Scherrer, Alice Schoenauer Sebag, Patrick Schramowski, Abolfazl Shahbazi, Vin Sharma, Xudong Shen, Vamsi Sistla, Leonard Tang, Davide Testuggine, Vithursan Thangarasa, Elizabeth Anne Watkins, Rebecca Weiss, Chris Welty, Tyler Wilbers, Adina Williams, Carole-Jean Wu, Poonam Yadav, Xianjun Yang, Yi Zeng, Wenhui Zhang, Fedor Zhdanov, Jiacheng Zhu, Percy Liang, Peter Mattson, Joaquin Vanschoren:
Introducing v0.5 of the AI Safety Benchmark from MLCommons. CoRR abs/2404.12241 (2024) - [i28]Nitisha Jain, Mubashara Akhtar, Joan Giner-Miguelez, Rajat Shinde, Joaquin Vanschoren, Steffen Vogler, Subhra S. Goswami, Yuhan Rao, Tim Santos, Luis Oala, Michalis Karamousadakis, Manil Maskey, Pierre Marcenac, Costanza Conforti, Michael Kuchnik, Lora Aroyo, Omar Benjelloun, Elena Simperl:
A Standardized Machine-readable Dataset Documentation Format for Responsible AI. CoRR abs/2407.16883 (2024) - 2023
- [j33]Hannah Rashkin, Vitaly Nikolaev, Matthew Lamm, Lora Aroyo, Michael Collins, Dipanjan Das, Slav Petrov, Gaurav Singh Tomar, Iulia Turc, David Reitter:
Measuring Attribution in Natural Language Generation Models. Comput. Linguistics 49(4): 777-840 (2023) - [c137]Shira Wein, Christopher Homan, Lora Aroyo, Chris Welty:
Follow the leader(board) with confidence: Estimating p-values from a single test set with item and response variance. ACL (Findings) 2023: 3138-3161 - [c136]Mohammad Tahaei, Marios Constantinides, Daniele Quercia, Sean Kennedy, Michael J. Muller, Simone Stumpf, Q. Vera Liao, Ricardo Baeza-Yates, Lora Aroyo, Jess Holbrook, Ewa Luger, Michael Madaio, Ilana Golbin Blumenfeld, Maria De-Arteaga, Jessica Vitak, Alexandra Olteanu:
Human-Centered Responsible Artificial Intelligence: Current & Future Trends. CHI Extended Abstracts 2023: 515:1-515:4 - [c135]Bhaktipriya Radharapu, Kevin Robinson, Lora Aroyo, Preethi Lahoti:
AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications. EMNLP (Industry Track) 2023: 380-395 - [c134]Lora Aroyo, Alex S. Taylor, Mark Díaz, Christopher Homan, Alicia Parrish, Gregory Serapio-García, Vinodkumar Prabhakaran, Ding Wang:
DICES Dataset: Diversity in Conversational AI Evaluation for Safety. NeurIPS 2023 - [c133]Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Alicia Parrish, Hannah Rose Kirk, Jessica Quaye, Charvi Rastogi, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Will Cukierski, Juan Ciro, Lora Aroyo, Bilge Acun, Lingjiao Chen, Mehul Raje, Max Bartolo, Evan Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Addison Howard, Oana Inel, Tariq Kane, Christine R. Kirkpatrick, D. Sculley, Tzu-Sheng Kuo, Jonas W. Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Y. Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi:
DataPerf: Benchmarks for Data-Centric AI Development. NeurIPS 2023 - [e21]Ying Ding, Jie Tang, Juan F. Sequeda, Lora Aroyo, Carlos Castillo, Geert-Jan Houben:
Proceedings of the ACM Web Conference 2023, WWW 2023, Austin, TX, USA, 30 April 2023 - 4 May 2023. ACM 2023, ISBN 978-1-4503-9416-1 [contents] - [e20]Ying Ding, Jie Tang, Juan F. Sequeda, Lora Aroyo, Carlos Castillo, Geert-Jan Houben:
Companion Proceedings of the ACM Web Conference 2023, WWW 2023, Austin, TX, USA, 30 April 2023 - 4 May 2023. ACM 2023, ISBN 978-1-4503-9419-2 [contents] - [i27]Lora Aroyo, Mark Diaz, Christopher Homan, Vinodkumar Prabhakaran, Alex S. Taylor, Ding Wang:
The Reasonable Effectiveness of Diverse Evaluation Data. CoRR abs/2301.09406 (2023) - [i26]Mohammad Tahaei, Marios Constantinides, Daniele Quercia, Sean Kennedy, Michael J. Muller, Simone Stumpf, Q. Vera Liao, Ricardo Baeza-Yates, Lora Aroyo, Jess Holbrook, Ewa Luger, Michael Madaio, Ilana Golbin Blumenfeld, Maria De-Arteaga, Jessica Vitak, Alexandra Olteanu:
Human-Centered Responsible Artificial Intelligence: Current & Future Trends. CoRR abs/2302.08157 (2023) - [i25]Alicia Parrish, Hannah Rose Kirk, Jessica Quaye, Charvi Rastogi, Max Bartolo, Oana Inel, Juan Ciro, Rafael Mosquera, Addison Howard, Will Cukierski, D. Sculley, Vijay Janapa Reddi, Lora Aroyo:
Adversarial Nibbler: A Data-Centric Challenge for Improving the Safety of Text-to-Image Models. CoRR abs/2305.14384 (2023) - [i24]Lora Aroyo, Alex S. Taylor, Mark Diaz, Christopher M. Homan, Alicia Parrish, Greg Serapio-García, Vinodkumar Prabhakaran, Ding Wang:
DICES Dataset: Diversity in Conversational AI Evaluation for Safety. CoRR abs/2306.11247 (2023) - [i23]Christopher M. Homan, Greg Serapio-García, Lora Aroyo, Mark Diaz, Alicia Parrish, Vinodkumar Prabhakaran, Alex S. Taylor, Ding Wang:
Intersectionality in Conversational AI Safety: How Bayesian Multilevel Models Help Understand Diverse Perceptions of Safety. CoRR abs/2306.11530 (2023) - [i22]Alicia Parrish, Sarah Laszlo, Lora Aroyo:
"Is a picture of a bird a bird": Policy recommendations for dealing with ambiguity in machine vision models. CoRR abs/2306.15777 (2023) - [i21]Oana Inel, Tim Draws, Lora Aroyo:
Collect, Measure, Repeat: Reliability Factors for Responsible AI Data Collection. CoRR abs/2308.12885 (2023) - [i20]Vinodkumar Prabhakaran, Christopher Homan, Lora Aroyo, Alicia Parrish, Alex S. Taylor, Mark Díaz, Ding Wang:
A Framework to Assess (Dis)agreement Among Diverse Rater Groups. CoRR abs/2311.05074 (2023) - [i19]Bhaktipriya Radharapu, Kevin Robinson, Lora Aroyo, Preethi Lahoti:
AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications. CoRR abs/2311.08592 (2023) - [i18]Luis Oala, Manil Maskey, Lilith Bat-Leah, Alicia Parrish, Nezihe Merve Gürel, Tzu-Sheng Kuo, Yang Liu, Rotem Dror, Danilo Brajovic, Xiaozhe Yao, Max Bartolo, William Gaviria Rojas, Ryan Hileman, Rainier Aliment, Michael W. Mahoney, Meg Risdal, Matthew Lease, Wojciech Samek, Debojyoti Dutta, Curtis G. Northcutt, Cody Coleman, Braden Hancock, Bernard Koch, Girmaw Abebe Tadesse, Bojan Karlas, Ahmed M. Alaa, Adji Bousso Dieng, Natasha F. Noy, Vijay Janapa Reddi, James Zou, Praveen K. Paritosh, Mihaela van der Schaar, Kurt D. Bollacker, Lora Aroyo, Ce Zhang, Joaquin Vanschoren, Isabelle Guyon, Peter Mattson:
DMLR: Data-centric Machine Learning Research - Past, Present and Future. CoRR abs/2311.13028 (2023) - 2022
- [j32]Chris Welty, Lora Aroyo, Flip Korn, Sara M. McCarthy, Shubin Zhao:
Addressing Label Sparsity With Class-Level Common Sense for Google Maps. Frontiers Artif. Intell. 5: 830299 (2022) - [j31]Lora Aroyo, Matthew Lease, Praveen K. Paritosh, Mike Schaekermann:
Data excellence for AI: why should you care? Interactions 29(2): 66-69 (2022) - [j30]Oana Inel, Lora Aroyo:
Fine-tuning machine confidence with human relevance for video discovery. Interactions 29(4): 78-82 (2022) - [c132]Christopher Homan, Tharindu Cyril Weerasooriya, Lora Aroyo, Chris Welty:
Annotator Response Distributions as a Sampling Frame. NLPerspectives@LREC 2022: 56-65 - [i17]Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Kathleen S. Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Agüera y Arcas, Claire Cui, Marian Croak, Ed H. Chi, Quoc Le:
LaMDA: Language Models for Dialog Applications. CoRR abs/2201.08239 (2022) - [i16]Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Juan Ciro, Lora Aroyo, Bilge Acun, Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Tariq Kane, Christine R. Kirkpatrick, Tzu-Sheng Kuo, Jonas Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi:
DataPerf: Benchmarks for Data-Centric AI Development. CoRR abs/2207.10062 (2022) - 2021
- [j29]Anca Dumitrache, Oana Inel, Benjamin Timmermans, Carlos Martinez-Ortiz, Robert-Jan Sips, Lora Aroyo, Chris Welty:
Empirical methodology for crowdsourcing ground truth. Semantic Web 12(3): 403-421 (2021) - [c131]Ka Wong, Praveen K. Paritosh, Lora Aroyo:
Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability. ACL/IJCNLP (1) 2021: 7053-7065 - [c130]Nithya Sambasivan, Shivani Kapania, Hannah Highfill, Diana Akrong, Praveen K. Paritosh, Lora Aroyo:
"Everyone wants to do the model work, not the data work": Data Cascades in High-Stakes AI. CHI 2021: 39:1-39:15 - [c129]Chris Welty, Lora Aroyo, Flip Korn, Sara M. McCarthy, Shubin Zhao:
Rapid Instance-Level Knowledge Acquisition for Google Maps from Class-Level Common Sense. HCOMP 2021: 143-154 - [i15]Ka Wong, Praveen K. Paritosh, Lora Aroyo:
Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability. CoRR abs/2106.07393 (2021) - [i14]Lora Aroyo, Matthew Lease, Praveen K. Paritosh, Mike Schaekermann:
Data Excellence for AI: Why Should You Care. CoRR abs/2111.10391 (2021) - 2020
- [j28]Mike Schaekermann, Christopher Homan, Lora Aroyo, Praveen K. Paritosh, Kurt D. Bollacker, Chris Welty:
The AI Bookie - Place Your Bets: Will Machine Learning Outgrow Human Labeling? AI Mag. 41(4): 123-126 (2020) - [j27]Lora Aroyo, Franciska de Jong, Eero Hyvönen, Sara Tonelli:
Web Semantics for Digital Humanities. J. Web Semant. 61-62: 100569 (2020) - [c128]Oana Inel, Nava Tintarev, Lora Aroyo:
Eliciting User Preferences for Personalized Explanations for Video Summaries. UMAP 2020: 98-106 - [e19]Lora Aroyo, Elena Simperl:
Proceedings of the Eighth AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2020, Hilversum, The Netherlands (virtual), October 25-29, 2020. AAAI Press 2020, ISBN 978-1-57735-848-0 [contents] - [i13]Oana Inel, Nava Tintarev, Lora Aroyo:
Eliciting User Preferences for Personalized Explanations for Video Summaries. CoRR abs/2005.00465 (2020)
2010 – 2019
- 2019
- [j26]Chris Welty, Lora Aroyo, Eric Horvitz:
The AI Bookie The Future of Voice Interfaces to Intelligent Assistants. AI Mag. 40(1): 79-82 (2019) - [j25]Chris Dijkshoorn, Victor de Boer, Lora Aroyo, Guus Schreiber:
Accurator: Nichesourcing for Cultural Heritage. Hum. Comput. 6: 12-41 (2019) - [c127]Oana Inel, Lora Aroyo:
Validation Methodology for Expert-Annotated Datasets: Event Annotation Case Study. LDK 2019: 12:1-12:15 - [c126]Anca Dumitrache, Lora Aroyo, Chris Welty:
A Crowdsourced Frame Disambiguation Corpus with Ambiguity. NAACL-HLT (1) 2019: 2164-2170 - [c125]Lora Aroyo, Lucas Dixon, Nithum Thain, Olivia Redfield, Rachel Rosen:
Crowdsourcing Subjective Tasks: The Case Study of Understanding Toxicity in Online Discussions. WWW (Companion Volume) 2019: 1100-1105 - [c124]Lora Aroyo, Anca Dumitrache, Oana Inel, Zoltán Szlávik, Benjamin Timmermans, Chris Welty:
Crowdsourcing Inclusivity: Dealing with Diversity of Opinions, Perspectives and Ambiguity in Annotated Data. WWW (Companion Volume) 2019: 1294-1295 - [i12]Anca Dumitrache, Lora Aroyo, Chris Welty:
A Crowdsourced Frame Disambiguation Corpus with Ambiguity. CoRR abs/1904.06101 (2019) - [i11]Chris Welty, Praveen K. Paritosh, Lora Aroyo:
Metrology for AI: From Benchmarks to Instruments. CoRR abs/1911.01875 (2019) - 2018
- [j24]Lora Aroyo, Anca Dumitrache, Jeffrey V. Nickerson, Matthew Lease, Pietro Michelucci:
Reports of the Workshops Held at the Sixth AAAI Conference on Human Computation and Crowdsourcing. AI Mag. 39(4): 57-63 (2018) - [j23]Chris Dijkshoorn, Lora Aroyo, Jacco van Ossenbruggen, Guus Schreiber:
Modeling cultural heritage data for online publication. Appl. Ontology 13(4): 255-271 (2018) - [j22]Chris Dijkshoorn, Lizzy Jongma, Lora Aroyo, Jacco van Ossenbruggen, Guus Schreiber, Wesley ter Weele, Jan Wielemaker:
The Rijksmuseum collection as Linked Data. Semantic Web 9(2): 221-230 (2018) - [j21]Marta Sabou, Lora Aroyo, Kalina Bontcheva, Alessandro Bozzon, Rehab K. Qarout:
Semantic Web and Human Computation: The status of an emerging field. Semantic Web 9(3): 291-302 (2018) - [j20]Anca Dumitrache, Lora Aroyo, Chris Welty:
Crowdsourcing Ground Truth for Medical Relation Extraction. ACM Trans. Interact. Intell. Syst. 8(2): 11:1-11:20 (2018) - [c123]Oana Inel, Giannis Haralabopoulos, Dan Li, Christophe Van Gysel, Zoltán Szlávik, Elena Simperl, Evangelos Kanoulas, Lora Aroyo:
Studying Topical Relevance with Evidence-based Crowdsourcing. CIKM 2018: 1253-1262 - [c122]Chantal van Son, Roser Morante, Lora Aroyo, Piek Vossen:
Scoring and Classifying Implicit Positive Interpretations: A Challenge of Class Imbalance. COLING 2018: 2253-2264 - [c121]Roeland Ordelman, Carlos Martinez-Ortiz, Liliana M. Melgar Estrada, Marijn Koolen, Jaap Blom, Willem Melder, Jasmijn van Gorp, Victor de Boer, Themistoklis Karavellas, Lora Aroyo, Thomas Poell, Norah Karrouche, Eva Baaren, Johannes Wassenaar, Julia Noordegraaf, Oana Inel:
Challenges in Enabling Mixed Media Scholarly Research with Multi-media Data in a Sustainable Infrastructure. DH 2018: 246-249 - [c120]Davide Ceolin, Jacco van Ossenbruggen, Lora Aroyo, Ozkan Sener, Robin Sharma, Lesia Tkacz, Julia Noordegraaf:
Assessing and Visualising Online Information Quality. eScience 2018: 356-357 - [c119]Anca Dumitrache, Lora Aroyo, Chris Welty:
Crowdsourcing Semantic Label Propagation in Relation Classification. FEVER@EMNLP 2018: 16-21 - [c118]Anca Dumitrache, Oana Inel, Lora Aroyo, Benjamin Timmermans, Chris Welty:
CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement (short paper). SAD/CrowdBias@HCOMP 2018: 11-18 - [c117]Anca Dumitrache, Lora Aroyo, Chris Welty:
Capturing Ambiguity in Crowdsourcing Frame Disambiguation. HCOMP 2018: 12-20 - [c116]Oana Inel, Sabrina Sauer, Lora Aroyo:
A Study of Narrative Creation by Means of Crowds and Niches. HCOMP (WIP&Demo) 2018 - [c115]Markus de Jong, Panagiotis Mavridis, Lora Aroyo, Alessandro Bozzon, Jesse de Vos, Johan Oomen, Antoaneta Dimitrova, Alec Badenoch:
CaptureBias: Supporting Media Scholars with Ambiguity-Aware Bias Representation for News Videos (short paper). SAD/CrowdBias@HCOMP 2018: 32-40 - [c114]Panagiotis Mavridis, Markus de Jong, Lora Aroyo, Alessandro Bozzon, Jesse de Vos, Johan Oomen, Antoaneta Dimitrova, Alec Badenoch:
A Human in the Loop Approach to Capture Bias and Support Media Scientists in News Video Analysis (short paper). SAD/CrowdBias@HCOMP 2018: 88-92 - [c113]Chantal van Son, Oana Inel, Roser Morante, Lora Aroyo, Piek Vossen:
Resource Interoperability for Sustainable Benchmarking: The Case of Events. LREC 2018 - [c112]Sven van den Beukel, Lora Aroyo:
Homonym Detection For Humor Recognition In Short Text. WASSA@EMNLP 2018: 286-291 - [c111]Lora Aroyo, Gianluca Demartini, Anna Lisa Gentile, Chris Welty:
Augmenting Intelligence with Humans-in-the-Loop (HumL@WWW2018) Chairs' Welcome & Organization. WWW (Companion Volume) 2018: 1099-1100 - [c110]Lora Aroyo, Chris Welty:
The Quantum Collective. WWW (Companion Volume) 2018: 1101-1103 - [e18]Lora Aroyo, Anca Dumitrache, Praveen K. Paritosh, Alexander J. Quinn, Chris Welty, Alessandro Checco, Gianluca Demartini, Ujwal Gadiraju, Cristina Sarasua:
Proceedings of the 1st Workshop on Subjectivity, Ambiguity and Disagreement in Crowdsourcing, and Short Paper Proceedings of the 1st Workshop on Disentangling the Relation Between Crowdsourcing and Bias Management (SAD 2018 and CrowdBias 2018) co-located the 6th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2018), Zürich, Switzerland, July 5, 2018. CEUR Workshop Proceedings 2276, CEUR-WS.org 2018 [contents] - [e17]Anna Fensel, Laura Daniele, Lora Aroyo, Victor de Boer, Sándor Darányi, Omar Elloumi, Raúl García-Castro, Laura Hollink, Oana Inel, Gerard Kuys, Maria Maleshkova, Munir Merdan, Albert Meroño-Peñuela, Thomas Moser, Felix Leif Keppmann, Efstratios Kontopoulos, Lodewijk Petram, Enrico Scarrone, Ruben Verborgh:
Joint Proceedings of SEMANTiCS 2017 Workshops co-located with the 13th International Conference on Semantic Systems (SEMANTiCS 2017), Amsterdam, Netherlands, September 11 and 14, 2017. CEUR Workshop Proceedings 2063, CEUR-WS.org 2018 [contents] - [e16]Anna Lisa Gentile, Lora Aroyo, Gianluca Demartini, Chris Welty:
Proceedings of the 2nd International Workshop on Augmenting Intelligence with Humans-in-the-Loop co-located with 17th International Semantic Web Conference (ISWC 2018), Monterey, California, October 9th, 2018. CEUR Workshop Proceedings 2169, CEUR-WS.org 2018 [contents] - [d3]Anca Dumitrache, Lora Aroyo, Chris Welty:
CrowdTruth Corpus for Open Domain Relation Extraction from Sentences. Zenodo, 2018
- [d2]Anca Dumitrache, Lora Aroyo, Chris Welty:
FrameNet Semantic Frame Disambiguation with CrowdTruth. Zenodo, 2018 - [i10]Anca Dumitrache, Lora Aroyo, Chris Welty:
Capturing Ambiguity in Crowdsourcing Frame Disambiguation. CoRR abs/1805.00270 (2018) - [i9]Anca Dumitrache, Oana Inel, Lora Aroyo, Benjamin Timmermans, Chris Welty:
CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement. CoRR abs/1808.06080 (2018) - [i8]Anca Dumitrache, Lora Aroyo, Chris Welty:
Crowdsourcing Semantic Label Propagation in Relation Classification. CoRR abs/1809.00537 (2018) - [i7]Anca Dumitrache, Oana Inel, Benjamin Timmermans, Carlos Martinez-Ortiz, Robert-Jan Sips, Lora Aroyo, Chris Welty:
Empirical Methodology for Crowdsourcing Ground Truth. CoRR abs/1809.08888 (2018) - 2017
- [j19]Riste Gligorov, Michiel Hildebrand, Jacco van Ossenbruggen, Lora Aroyo, Guus Schreiber:
Topical Video Search: Analysing Video Concept Annotation through Crowdsourcing Games. Hum. Comput. 4(1): 47-70 (2017) - [j18]Pasquale De Meo, Katarzyna Musial-Gabrys, Domenico Rosaci, Giuseppe M. L. Sarnè, Lora Aroyo:
Using Centrality Measures to Predict Helpfulness-Based Reputation in Trust Networks. ACM Trans. Internet Techn. 17(1): 8:1-8:20 (2017) - [c109]Anca Dumitrache, Lora Aroyo, Chris Welty:
False Positive and Cross-relation Signals in Distant Supervision Data. AKBC@NIPS 2017 - [c108]Oana Inel, Lora Aroyo:
Harnessing Diversity in Crowds and Machines for Better NER Performance. ESWC (1) 2017: 289-304 - [c107]Jessie Both, Didi de Hooge, Ramses IJff, Oana Inel, Victor de Boer, Lora Aroyo:
Linking Dutch World War II Cultural Heritage Collections with Events Extracted by Machines and Crowds. SEMANTiCS (Workshops) 2017 - [c106]Kim van Putten, Oana Inel, Victor de Boer, Lora Aroyo:
Event Extraction From Radio News Bulletins. SEMANTiCS (Workshops) 2017 - [c105]Justin Verhulst, Oana Inel, Victor de Boer, Lora Aroyo:
Optimizing Explorative Search for the Needs of Media Professionals: The DIVE+ Use Case. SEMANTiCS (Workshops) 2017 - [c104]Valentina Maccatrozzo, Manon Terstall, Lora Aroyo, Guus Schreiber:
SIRUP: Serendipity In Recommendations via User Perceptions. IUI 2017: 35-44 - [c103]Victor de Boer, Liliana Melgar, Oana Inel, Carlos Martinez-Ortiz, Lora Aroyo, Johan Oomen:
Enriching Media Collections for Event-Based Exploration. MTSR 2017: 189-201 - [c102]Benjamin Timmermans, Tobias Kuhn, Kaspar Beelen, Lora Aroyo:
Computational Controversy. SocInfo (2) 2017: 288-300 - [c101]Valentina Maccatrozzo, Eveline van Everdingen, Lora Aroyo, Guus Schreiber:
Everybody, More or Less, likes Serendipity. UMAP (Adjunct Publication) 2017: 29-34 - [e15]Lora Aroyo, Fabien Gandon:
Proceedings of the Doctoral Consortium at the 16th International Semantic Web Conference (ISWC 2017) co-located with 16th International Semantic Web Conference (ISWC 2017), Vienna, Austria, October 22nd, 2017. CEUR Workshop Proceedings 1962, CEUR-WS.org 2017 [contents] - [i6]Anca Dumitrache, Lora Aroyo, Chris Welty:
Crowdsourcing Ground Truth for Medical Relation Extraction. CoRR abs/1701.02185 (2017) - [i5]Benjamin Timmermans, Tobias Kuhn, Kaspar Beelen, Lora Aroyo:
Computational Controversy. CoRR abs/1706.07643 (2017) - [i4]Chris Dijkshoorn, Victor de Boer, Lora Aroyo, Guus Schreiber:
Accurator: Nichesourcing for Cultural Heritage. CoRR abs/1709.09249 (2017) - [i3]Anca Dumitrache, Lora Aroyo, Chris Welty:
False Positive and Cross-relation Signals in Distant Supervision Data. CoRR abs/1711.05186 (2017) - 2016
- [c100]Chantal van Son, Tommaso Caselli, Antske Fokkens, Isa Maks, Roser Morante, Lora Aroyo, Piek Vossen:
Unshared Task at the 3rd Workshop on Argument Mining: Perspective Based Local Agreement and Disagreement in Online Debate. ArgMining@ACL 2016 - [c99]Zhaochun Ren, Oana Inel, Lora Aroyo, Maarten de Rijke:
Time-aware Multi-Viewpoint Summarization of Multilingual Social Text Streams. CIKM 2016: 387-396 - [c98]Davide Ceolin, Julia Noordegraaf, Lora Aroyo:
Capturing the Ineffable: Collecting, Analysing, and Automating Web Document Quality Assessments. EKAW 2016: 83-97 - [c97]Oana Inel, Tommaso Caselli, Lora Aroyo:
Crowdsourcing Salient Information from News and Tweets. LREC 2016 - [c96]Emiel van Miltenburg, Benjamin Timmermans, Lora Aroyo:
The VU Sound Corpus: Adding More Fine-grained Annotations to the Freesound Database. LREC 2016 - [c95]Chantal van Son, Tommaso Caselli, Antske Fokkens, Isa Maks, Roser Morante, Lora Aroyo, Piek Vossen:
GRaSP: A Multilayered Annotation Scheme for Perspectives. LREC 2016 - [c94]Davide Ceolin, Lora Aroyo, Julia Noordegraaf:
Identifying and Classifying Uncertainty Layers in Web Document Quality Assessment. URSW@ISWC 2016: 61-64 - [c93]Davide Ceolin, Julia Noordegraaf, Lora Aroyo, Chantal van Son:
Towards web documents quality assessment for digital humanities scholars. WebSci 2016: 315-317 - [e14]Julita Vassileva, James Blustein, Lora Aroyo, Sidney K. D'Mello:
Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization, UMAP 2016, Halifax, NS, Canada, July 13 - 17, 2016. ACM 2016, ISBN 978-1-4503-4368-8 [contents] - [d1]Anca Dumitrache, Lora Aroyo, Chris Welty:
Medical Relation Extraction Gold Standard with CrowdTruth. Zenodo, 2016 - 2015
- [j17]Lora Aroyo, Chris Welty:
Truth Is a Lie: Crowd Truth and the Seven Myths of Human Annotation. AI Mag. 36(1): 15-24 (2015) - [j16]Jasper Oosterman, Jie Yang, Alessandro Bozzon, Lora Aroyo, Geert-Jan Houben:
On the impact of knowledge extraction and aggregation on crowdsourced annotation of visual artworks. Comput. Networks 90: 133-149 (2015) - [j15]