SYSTEMS RESEARCH

HUMAN & MACHINE INTELLIGENCE

OASIs: oracle assessment and improvement tool

July 12, 2018

Abstract

The oracle problem remains one of the key challenges in software testing, for which little automated support has been developed so far. We introduce OASIs, a search-based tool for Java that assists testers in oracle assessment and improvement. It does so by combining test case generation to reveal false positives and mutation testing to reveal false negatives. In this work, we describe how OASIs works, provide details of its implementation, and explain how it can be used in an iterative oracle improvement process with a human in the loop. Finally, we present a summary of previous empirical evaluation showing that the fault detection rate of the oracles after improvement using OASIs increases, on average, by 48.6%.

Download the Paper

AUTHORS

Written by

Gunel Jahangirova

David Clark

Mark Harman

Paolo Tonella

Publisher

International Symposium on Software Testing and Analysis (ISSTA) 2018

Related Publications

August 15, 2019

HUMAN & MACHINE INTELLIGENCE

PHYRE: A New Benchmark for Physical Reasoning | Facebook AI Research

Understanding and reasoning about physics is an important ability of intelligent agents. We develop the PHYRE benchmark for physical reasoning that contains a set of simple classical mechanics puzzles in a 2D physical environment. The benchmark…

Anton Bakhtin, Laurens van der Maaten, Justin Johnson, Laura Gustafson, Ross Girshick

August 15, 2019

July 09, 2018

HUMAN & MACHINE INTELLIGENCE

Continuous Reasoning: Scaling the Impact of Formal Methods | Facebook AI Research

This paper describes work in continuous reasoning, where formal reasoning about a (changing) codebase is done in a fashion which mirrors the iterative, continuous model of software development that is increasingly practiced in industry. We…

Peter O'Hearn

July 09, 2018

July 12, 2018

HUMAN & MACHINE INTELLIGENCE

OASIs: oracle assessment and improvement tool

The oracle problem remains one of the key challenges in software testing, for which little automated support has been developed so far.…

Gunel Jahangirova, David Clark, Mark Harman, Paolo Tonella

July 12, 2018

April 24, 2017

HUMAN & MACHINE INTELLIGENCE

COMPUTER VISION

Episodic Exploration for Deep Deterministic Policies for StarCraft Micro-Management | Facebook AI Research

We consider scenarios from the real-time strategy game StarCraft as benchmarks for reinforcement learning algorithms. We focus on micromanagement, that is, the short-term, low-level control of team members during a battle. We propose several…

Nicolas Usunier, Gabriel Synnaeve, Zeming Lin, Soumith Chintala

April 24, 2017

Help Us Pioneer The Future of AI

We share our open source frameworks, tools, libraries, and models for everything from research exploration to large-scale production deployment.