ICST 2019 invites high quality submissions in all areas of software testing, verification, and validation. Papers for the research track should present novel and original work that pushes the state-of-the-art. Case studies and empirical research papers are also welcome.

Topics of interest include, but is not limited to, the following:

● Domain specific testing, such as: mobile or web app testing, embedded systems testing, concurrent systems, GUI testing, etc.

● Formal verification

● Model based testing

● Model checking

● Manual testing practices and techniques

● Search based software testing

● Security testing

● Software reliability

● Test automation

● Testability and design

● Testing and development processes

● Testing education

● Testing in specific domains, such as mobile, web, embedded, concurrent, distributed, cloud, and real-time systems

● Testing/debugging tools

● Theory of software testing

● Empirical studies

● Experience reports

Each submission will be reviewed by at least three members of the ICST Program Committee.

Papers that have a strong industrial/practical component and focus more on impact rather than (technical) novelty are encouraged to consider the industry track instead.

Format

Full Research Papers as well as Industry papers must conform to the two-column IEEE conference publication format. Templates for LaTeX and Microsoft Word are available from http://www.ieee.org/conferences_events/conferences/publishing/templates.html: please use the letter format template and conference option.

Papers should be submitted in the PDF format: they must not exceed ten pages, plus up to two pages of references. Submissions will be handled via EasyChair.

Papers must neither have been previously accepted for publication nor be under submission in another conference or journal. The ICST 2019 research track accepts only full research papers. Short papers are not accepted to the research track.

For your paper to be published in the ICST 2019 conference proceedings, at least one of the authors of the paper must register for the conference and confirm that she/he will present the paper in person.

Submission Site: https://easychair.org/conferences/?conf=icst2019

Important Dates (all dates are AoE)

● October 5th, 2018: Submission of Abstract

● October 12th, 2018: Submission of Full Research Papers

● December 18th, 2018: Author Notification

● Main Conference: April 24-26th (workshops and other events occur before/after these dates)

Double Blind

ICST 2019 is adopting Double Blind Reviewing: research track submissions should not reveal the identity of author(s) in any way; names and affiliations should be left out. Authors should also ensure that citations to their own work are written in third person (i.e. do not write “our previous work”; use “the previous work of X”).

Double Blind Process FAQ

   

Q: How does one prepare an ICST 2019 submission for double-­blind reviewing?

In order to comply, you do not have to make your identity undiscoverable; the double­-blind aspect of the review process is not an adversarial identity discovery process. Essentially, the guiding principle should be to maximize the number of people who could plausibly be authors, subject to the constraint that no change is made to any technical details of the work. Therefore, you should ensure that the reviewers are able to read and review your paper without having to know who any of the authors are. Specifically, this involves at least the following four points:

1. Omitting all authors’ names, affiliations, emails and related information from the title page as well as in the paper itself.

2. Referring to your own work in the third person. You should not change the names of your own tools, approaches or systems, since this would clearly compromise the review process. It breaks the constraint that “no change is made to any technical details of the work”. However, you should always refer to the authorship/provenance of tools, approaches or systems in the third person, so that it is credible that another author could have written your paper.

3. Not relying on supplementary material (your web site, GitHub repository, YouTube channel) in the paper. Supplementary information might result in revealing author identities.

4. Anonymize project and grant names and numbers or those of funding agencies or countries as well as any acknowledgements of support to the work you report on.

We further expect you to follow the excellent advice on anonymization from ACM: https://icer.hosting.acm.org/icer-2017/additional-advice-on-anonymization/

When anonymizing your email, affiliations, name etc. try to refrain from being overly creative or “funny” by coming up with your own, anonymized versions. For emails preferably use author1@anon.org, author2@anon.org, etc. since initial DBR screening will be done by an automated tool.

Q: I previously published an earlier version of this work in a venue that doesn’t have double-blind. What should I do about acknowledging that previous work?

Double-blind does not and cannot mean that it’s impossible for the referees to discover the identity of the author. However, we require authors to help make it easy for author identity to not play a role in the reviewing process. Therefore, we ask that in the materials you submit to us to be reviewed author identity is not revealed.

If the work you are submitting for review has previously been published in a non-peer-reviewed venue (e.g., arXiv departmental tech report), there is no need to cite it, because unrefereed work is not truly part of the scientific literature. If the previous work is published in a peer-reviewed venue, then it should be cited, but in the third person so that it is not clear whether or not this work was done by the author of the submitted paper or some other set of authors unknown. However, if citing in the third person would still risk that it is easy to identify the authors please err on the side of caution by also anonymising the papers being extended (both when cited and in the reference list).

Q: Our submission makes use of work from a PhD/master’s thesis dissertation/report which has been published. Citing the dissertation might compromise anonymity. What should we do?

It’s perfectly OK to publish work from a PhD/master’s thesis, and there’s no need to cite it in the version submitted for review because prior dissertation publication does not compromise novelty. In the final (post-review, camera ready) version of the paper, please do cite the dissertation to acknowledge its contribution, but in the refereed version of the paper that you submit, please refrain from citing the dissertation.

However, you need not worry whether or not the dissertation has appeared, since your job is only to help the committee review your work without awareness of author identity, but not to make it impossible for them to discover the identity of authors. The referees will be trying hard not to discover the authors’ identity, so they will likely not be searching the web to check whether there is a dissertation related to this work.

Q: I’m submitting to the industry track. Should i double-blind my submission?

No you should not. Since industry papers typically relies heavily on the industrial/practical context in which the work was carried out it would be too much to ask to require this context to be anonymized.

Q: I want to include a link to an online appendix in my submission. How should I do this?

Ideally the information in the appendix should be anonymous and it should be uploaded to an anonymous service such as for example figshare or create a new github (or other) sharing account that is not associated with your real name. These sites will give you a link that is anonymous. Later, if the paper is accepted you can turn that link into a non-anonymized link or just put the appendix on your own site and change the link in the camera ready version of the paper. An alternative solution is to not include the link in the submission; normally papers should be possible to review based on only the material of the paper itself.

To upload material on figshare please create an account there, then add a new item, use the keywords “Supplemental Materials” and add the other item-specific data and then select “Make file(s) confidential” and select “Generate private link”. Copy the url generated there and then “Save changes”. Your file(s) can now be accessed anonymously at the given url so you can put it in your ICST submission.