reviews/wcre2011
をテンプレートにして作成
[
トップ
] [
新規
|
一覧
|
検索
|
最終更新
|
ヘルプ
]
開始行:
[[reviews]]
* 18th Working Conference on Reverse Engineering (WCRE 20...
** WCRE 2011 notification for paper 107 [#h89a14db]
Dear Masao,
Thank you for your submission to the 18th Working Confere...
We are pleased to inform you that your paper:
The Impact of Bug Management Patterns on Bug Fixing: A ...
has been accepted as a SHORT paper for presentation at WC...
Papers went through a rigorous reviewing process. Of 104 ...
We enclose below the reviewers' comments to your submiss...
preparing the final, camera-ready copy of the paper. SHOR...
(please check http://www.computer.org/portal/web/cscps/fo...
If the paper has been submitted as FULL paper, please let...
sending an email to the Program Co-Chairs.
Your camera-ready paper is due on August 20, 2011. The in...
next couple of days.
It is a requirement that at least one of the authors regi...
Please also consider submitting to the Doctoral Symposium...
will receive feedback on his/her PhD studies and other ti...
Congratulations on having your paper accepted. We look fo...
Sincerely,
Denys Poshyvanyk and Martin Pinzger
WCRE 2011 Program Co-Chairs
**----------------------- REVIEW 1 --------------------- ...
PAPER: 107
TITLE: The Impact of Bug Management Patterns on Bug Fixin...
AUTHORS: Masao Ohira, Naoya Osawa, Ahmed E. Hassan and Ke...
Summary
------------
The authors present an empirical study carried out to eva...
fixing. In the context of the study the authors analyse h...
namely bug reporter, triager, and fixer, impact on the ti...
to fix it. In particular, the authors analyse four differ...
the actors involved in the bug management process. The re...
these patterns on the efficiency of the bug management pr...
Comments
------------
This is a very interesting paper. It is well written and ...
However, a deeper analysis of the achieved results is nee...
bug management process. To this aim, a deeper qualitative...
order to take into account other factors that could affec...
severity.
In addition, I did not completely understand the rational...
paper. The explorative study seems to be useful only (i) ...
between the actors involved in the bug management process...
the hypotheses made by the authors make sense. I really l...
extremely useful.
However, in my opinion it is not necessary, for the econo...
Indeed, the authors could avoid the description of the ex...
on the case study on bug management process. At the end o...
are reasonable and probably they could be derived also wi...
remove Section III (note that all the findings are also i...
study in Secion IV saying that the patterns were derived ...
In this way the authors can save almost on page. They can...
important issues related to the case study:
1. how does the quality of the bug report interact with t...
bug management process is affected by the skills of the b...
2. provide more details on how the communication between ...
report. Do the authors have any information about the num...
Summarising, the main merit of this paper is that it prov...
management process) taking into account not only informat...
files, but also putting humans in the loop considering th...
However, a deeper analysis of the results is required to ...
**----------------------- REVIEW 2 --------------------- ...
PAPER: 107
TITLE: The Impact of Bug Management Patterns on Bug Fixin...
AUTHORS: Masao Ohira, Naoya Osawa, Ahmed E. Hassan and Ke...
Summary
------------
The paper presents an empirical study, performed on Eclip...
between certain bug management process patterns and the t...
4 patterns: 1) the reporter, the triager and the fixer ar...
and the triager are the same person, while the fixer is a...
while the reporter is a different one.
In the study, the authors considered only bugs from 2007 ...
up with ~4000 bugs for the Eclipse platform, and ~1600 fo...
The study revealed that: when a reporter is also the tria...
a bug to fix to himself, such assignment takes longer tha...
time, the bug fixing is up to twice faster; when the repo...
is longer than in all other cases.
The authors argue that these results imply that a better ...
improve the bug management process, and thus decrease the...
Evaluation
--------------
The study presented in the paper is novel, interesting an...
extract the motivations for performing such a study from ...
paper with a pilot study improves the readability of the ...
the other hand.
Having said that, I have one major problem with the paper...
the time for assigning and fixing bugs, and just assume t...
assign) than others is lack of communication. For example...
impact the fixing time: they are neither considered nor m...
bugs with triager different from fixer take longer to fix...
one possible reason. For example, let us consider bugs wi...
fix); according to the authors, triagers are senior devel...
unimportant bugs, so it is quite likely that the triager ...
take long to fix is perhaps due to their low priority: si...
do" list by developers.
Because of the above reasons, in their analysis the autho...
provide convincing motivations of not doing so.
In short, I think that while the analysis that the author...
simplified, thus leading to claims that are too strong wi...
should elaborate more their interpretation and tune the c...
Moreover, I have the following remarks about the paper:
-The research questions RQ1 and RQ2 are too general and, ...
study. For example, RQ1 is "Does the type of reporter-tri...
However, the data used in the experiment is not sufficien...
distinguishes between the case in which the reporter and ...
different people. This can be hardly defined the "reporte...
like: "Does the fact that who reports a bug and who triag...
task?"
The final finding of the section (reported in the rounded...
RQ2.
-For the study, the authors filtered out bugs which were ...
the drawback of selecting only part of the bug population...
the results (see for example "Fair and balanced?: bias in...
id=1595716). Moreover, the authors only considered the bu...
considered time window would create a much larger dataset...
discuss the potential bias in the threats to validity.
-At page 7, the authors state "This phenomena likely happ...
bug fixing task but cannot get any response from the fixe...
to himself". Did the authors verified this fact on the da...
-Page 7, "We manually checked 100 randomly selected bug r...
select 100 samples and not 50 or 150? Does this number pr...
-I was surprised of not finding an in depth analysis of t...
this is what really matters. The authors somehow discuss ...
superficially, but in my opinion what is needed is to stu...
tests on it.
-Page 8, "Figure 8 shows the relationship between the bug...
the bug assignment in the Platform project. We see Tfix i...
Bugzilla) increase". This is really interesting but a bit...
paper. The authors can find the necessary space by shorte...
-At page 3, the authors state "If an individual plays bot...
developer. If not (reporter ̸= triager), it is likel...
reporter is a user? As the authors themselves state at pa...
to assign a bug fixing task to other developers in the pr...
people, they can be for example a senior developer (triag...
Concerning the presentation, the paper is fairly well str...
listed in the minor comments below.
All in all, what the authors should do, in my opinion, is:
- tune down their claims
- reformulate the research questions
- acknowledge the fact that tassign and tfix are influenc...
they are structured information (e.g., severity, priority)
- address the other remarks discussed in the review
Points in favor and against:
+ good motivations
+ interesting study
+ conservative statistical tests used (Mann-Whitney)
- the interpretation of the results it too simplified, wi...
- the claims are too strong with respect to the support g...
- some research questions are too general and cannot be a...
Minor comments
----------------------
--Figures and tables should be moved closer to the text t...
--The description of the Bug Management Patterns is too v...
--page 1, "is the first attempt at empirically study" -> ...
--page 1, "different individual playing different roles" ...
--reference [12] is now a TSE publication. See: http://ww...
--at page 2, the authors introduce the abbreviation BTS (...
mention it, i.e., at page 1 "Software projects use a bug ...
--page 2, "since the goal of existing studies as previous...
described, is to reduce
--page 2, "The triager can also be a reporter and/or a fi...
--page 2, "In such the case, the efficiency of the bug ma...
each role" -> In such a case, the efficiency of the bug m...
role
--figure 1, figure 2, and page 7, triagger -> triager
--"Table II shows the results of our analysis on Tfix. We...
both projects." -> Tfix for both projects
--page 4, "The are defined by combinations" -> They are
--page 4, "his ability to fix the fixing bug." -> fix the...
--page 5, "We can see that about half of reported bugs we...
Looking at table III, the total number of fixed bugs is 8...
tossing are 4'133, so they are about 1/3 of the reported ...
--In figure 5 and 7, using different line styles, instead...
Moreover, the figures should be zoomed on the y axis, as ...
--page 7, "We can see that the differences at 1% signific...
JDT". -> A verb is missing in this sentence.
--page 7, "to assing the tasks" -> assign
--page 9, "Some projects (i.e., JDT) put careful attentio...
but *one* project.
**----------------------- REVIEW 3 --------------------- ...
PAPER: 107
TITLE: The Impact of Bug Management Patterns on Bug Fixin...
AUTHORS: Masao Ohira, Naoya Osawa, Ahmed E. Hassan and Ke...
Summary
------------
This paper investigates the social aspect of the bug mana...
Points in favour
------------
-The paper is well written
-studying the social aspect of bug-triaging and classifyi...
Points against
------------
-when I read "bug management patterns" I was expecting so...
--case study is too small to provide results that can be ...
--Detailed Remarks (optional)
--- include page numbers when submitting a paper for revi...
--- last sentence of first paragraph: "bug reports from o...
--- triagging -> triaging
--- the total number of reports as stated in Section 6 (a...
終了行:
[[reviews]]
* 18th Working Conference on Reverse Engineering (WCRE 20...
** WCRE 2011 notification for paper 107 [#h89a14db]
Dear Masao,
Thank you for your submission to the 18th Working Confere...
We are pleased to inform you that your paper:
The Impact of Bug Management Patterns on Bug Fixing: A ...
has been accepted as a SHORT paper for presentation at WC...
Papers went through a rigorous reviewing process. Of 104 ...
We enclose below the reviewers' comments to your submiss...
preparing the final, camera-ready copy of the paper. SHOR...
(please check http://www.computer.org/portal/web/cscps/fo...
If the paper has been submitted as FULL paper, please let...
sending an email to the Program Co-Chairs.
Your camera-ready paper is due on August 20, 2011. The in...
next couple of days.
It is a requirement that at least one of the authors regi...
Please also consider submitting to the Doctoral Symposium...
will receive feedback on his/her PhD studies and other ti...
Congratulations on having your paper accepted. We look fo...
Sincerely,
Denys Poshyvanyk and Martin Pinzger
WCRE 2011 Program Co-Chairs
**----------------------- REVIEW 1 --------------------- ...
PAPER: 107
TITLE: The Impact of Bug Management Patterns on Bug Fixin...
AUTHORS: Masao Ohira, Naoya Osawa, Ahmed E. Hassan and Ke...
Summary
------------
The authors present an empirical study carried out to eva...
fixing. In the context of the study the authors analyse h...
namely bug reporter, triager, and fixer, impact on the ti...
to fix it. In particular, the authors analyse four differ...
the actors involved in the bug management process. The re...
these patterns on the efficiency of the bug management pr...
Comments
------------
This is a very interesting paper. It is well written and ...
However, a deeper analysis of the achieved results is nee...
bug management process. To this aim, a deeper qualitative...
order to take into account other factors that could affec...
severity.
In addition, I did not completely understand the rational...
paper. The explorative study seems to be useful only (i) ...
between the actors involved in the bug management process...
the hypotheses made by the authors make sense. I really l...
extremely useful.
However, in my opinion it is not necessary, for the econo...
Indeed, the authors could avoid the description of the ex...
on the case study on bug management process. At the end o...
are reasonable and probably they could be derived also wi...
remove Section III (note that all the findings are also i...
study in Secion IV saying that the patterns were derived ...
In this way the authors can save almost on page. They can...
important issues related to the case study:
1. how does the quality of the bug report interact with t...
bug management process is affected by the skills of the b...
2. provide more details on how the communication between ...
report. Do the authors have any information about the num...
Summarising, the main merit of this paper is that it prov...
management process) taking into account not only informat...
files, but also putting humans in the loop considering th...
However, a deeper analysis of the results is required to ...
**----------------------- REVIEW 2 --------------------- ...
PAPER: 107
TITLE: The Impact of Bug Management Patterns on Bug Fixin...
AUTHORS: Masao Ohira, Naoya Osawa, Ahmed E. Hassan and Ke...
Summary
------------
The paper presents an empirical study, performed on Eclip...
between certain bug management process patterns and the t...
4 patterns: 1) the reporter, the triager and the fixer ar...
and the triager are the same person, while the fixer is a...
while the reporter is a different one.
In the study, the authors considered only bugs from 2007 ...
up with ~4000 bugs for the Eclipse platform, and ~1600 fo...
The study revealed that: when a reporter is also the tria...
a bug to fix to himself, such assignment takes longer tha...
time, the bug fixing is up to twice faster; when the repo...
is longer than in all other cases.
The authors argue that these results imply that a better ...
improve the bug management process, and thus decrease the...
Evaluation
--------------
The study presented in the paper is novel, interesting an...
extract the motivations for performing such a study from ...
paper with a pilot study improves the readability of the ...
the other hand.
Having said that, I have one major problem with the paper...
the time for assigning and fixing bugs, and just assume t...
assign) than others is lack of communication. For example...
impact the fixing time: they are neither considered nor m...
bugs with triager different from fixer take longer to fix...
one possible reason. For example, let us consider bugs wi...
fix); according to the authors, triagers are senior devel...
unimportant bugs, so it is quite likely that the triager ...
take long to fix is perhaps due to their low priority: si...
do" list by developers.
Because of the above reasons, in their analysis the autho...
provide convincing motivations of not doing so.
In short, I think that while the analysis that the author...
simplified, thus leading to claims that are too strong wi...
should elaborate more their interpretation and tune the c...
Moreover, I have the following remarks about the paper:
-The research questions RQ1 and RQ2 are too general and, ...
study. For example, RQ1 is "Does the type of reporter-tri...
However, the data used in the experiment is not sufficien...
distinguishes between the case in which the reporter and ...
different people. This can be hardly defined the "reporte...
like: "Does the fact that who reports a bug and who triag...
task?"
The final finding of the section (reported in the rounded...
RQ2.
-For the study, the authors filtered out bugs which were ...
the drawback of selecting only part of the bug population...
the results (see for example "Fair and balanced?: bias in...
id=1595716). Moreover, the authors only considered the bu...
considered time window would create a much larger dataset...
discuss the potential bias in the threats to validity.
-At page 7, the authors state "This phenomena likely happ...
bug fixing task but cannot get any response from the fixe...
to himself". Did the authors verified this fact on the da...
-Page 7, "We manually checked 100 randomly selected bug r...
select 100 samples and not 50 or 150? Does this number pr...
-I was surprised of not finding an in depth analysis of t...
this is what really matters. The authors somehow discuss ...
superficially, but in my opinion what is needed is to stu...
tests on it.
-Page 8, "Figure 8 shows the relationship between the bug...
the bug assignment in the Platform project. We see Tfix i...
Bugzilla) increase". This is really interesting but a bit...
paper. The authors can find the necessary space by shorte...
-At page 3, the authors state "If an individual plays bot...
developer. If not (reporter ̸= triager), it is likel...
reporter is a user? As the authors themselves state at pa...
to assign a bug fixing task to other developers in the pr...
people, they can be for example a senior developer (triag...
Concerning the presentation, the paper is fairly well str...
listed in the minor comments below.
All in all, what the authors should do, in my opinion, is:
- tune down their claims
- reformulate the research questions
- acknowledge the fact that tassign and tfix are influenc...
they are structured information (e.g., severity, priority)
- address the other remarks discussed in the review
Points in favor and against:
+ good motivations
+ interesting study
+ conservative statistical tests used (Mann-Whitney)
- the interpretation of the results it too simplified, wi...
- the claims are too strong with respect to the support g...
- some research questions are too general and cannot be a...
Minor comments
----------------------
--Figures and tables should be moved closer to the text t...
--The description of the Bug Management Patterns is too v...
--page 1, "is the first attempt at empirically study" -> ...
--page 1, "different individual playing different roles" ...
--reference [12] is now a TSE publication. See: http://ww...
--at page 2, the authors introduce the abbreviation BTS (...
mention it, i.e., at page 1 "Software projects use a bug ...
--page 2, "since the goal of existing studies as previous...
described, is to reduce
--page 2, "The triager can also be a reporter and/or a fi...
--page 2, "In such the case, the efficiency of the bug ma...
each role" -> In such a case, the efficiency of the bug m...
role
--figure 1, figure 2, and page 7, triagger -> triager
--"Table II shows the results of our analysis on Tfix. We...
both projects." -> Tfix for both projects
--page 4, "The are defined by combinations" -> They are
--page 4, "his ability to fix the fixing bug." -> fix the...
--page 5, "We can see that about half of reported bugs we...
Looking at table III, the total number of fixed bugs is 8...
tossing are 4'133, so they are about 1/3 of the reported ...
--In figure 5 and 7, using different line styles, instead...
Moreover, the figures should be zoomed on the y axis, as ...
--page 7, "We can see that the differences at 1% signific...
JDT". -> A verb is missing in this sentence.
--page 7, "to assing the tasks" -> assign
--page 9, "Some projects (i.e., JDT) put careful attentio...
but *one* project.
**----------------------- REVIEW 3 --------------------- ...
PAPER: 107
TITLE: The Impact of Bug Management Patterns on Bug Fixin...
AUTHORS: Masao Ohira, Naoya Osawa, Ahmed E. Hassan and Ke...
Summary
------------
This paper investigates the social aspect of the bug mana...
Points in favour
------------
-The paper is well written
-studying the social aspect of bug-triaging and classifyi...
Points against
------------
-when I read "bug management patterns" I was expecting so...
--case study is too small to provide results that can be ...
--Detailed Remarks (optional)
--- include page numbers when submitting a paper for revi...
--- last sentence of first paragraph: "bug reports from o...
--- triagging -> triaging
--- the total number of reports as stated in Section 6 (a...
ページ名:
![[PukiWiki]](image/wadanyan.png "[PukiWiki]")
