Forums

An Open Letter to Developer Express on the Quality of C++ Support

Last post 2/8/2010 1:54 PM by Mark Miller (DevExpress). 18 replies.
Prev 1 2
Sort Posts: Previous Next
  • Richard

    Re: An Open Letter to Developer Express on the Quality of C++ Support

    1/6/2008 12:53 PM
    • Not Ranked
    • Joined on 5/5/2007
    • Salt Lake City, UT
    • Posts 12

    With 3.0.5:

    595 tests on 43 refactorings, 225 tests passing, 370 tests failing, 4 refactorings passing all tests.

    The number of passing tests went down because I didn't notice that Extract Function was always inserting "using namespace System;" in all cases (this is invalid for native C++).  So every test case for Extract Function fails.  I'm not quite sure what happened with this release, but this is the first time that I've had to re-open a significant number of closed defects that were marked as fixed for this release.

    All the bugs I've filed are public with the test suite attached.  I continue to modify and update the test suite based on bug activity and release activity. Not all of the refactorings are sufficiently covered by tests yet, so the suite is a work in progress.  However, I notice that I can attach a file to a message here, so I'll attach the test suite here too.  Each test is marked with #TEST# and an identifier and instructions for what to do.  One thing I haven't done is to comprehensively retest every test I've created with the latest release.  I've only validated the test cases that were supposed to be fixed in this release.

  • Trevor Westerdahl

    Re: An Open Letter to Developer Express on the Quality of C++ Support

    1/6/2008 4:15 PM
    • Top 25 Contributor
    • Joined on 5/4/2007
    • Portland, Oregon
    • Posts 2,424
    > All the bugs I've filed are public with the test suite attached.
     
    Now, that is helpful - awesome! There is no excuse for someone not to understand the issues (tests) you so kindly shared.
     
     
     
    Trevor Westerdahl - DX Squad
    BLOG: http://trevorunlocked.blogspot.com/
  • Richard

    Re: An Open Letter to Developer Express on the Quality of C++ Support

    2/4/2010 8:14 PM
    • Not Ranked
    • Joined on 5/5/2007
    • Salt Lake City, UT
    • Posts 12

     Results with 9.1.10:

    100%   Add/Remove Block Delimiter: 13 passed, 0 failed
    41.67% Add Parameter: 10 passed, 14 failed
    0%     Boolean to Enum S18427: 0 passed, 21 failed
    100%   Break Apart/Line Up Parameters: 4 passed, 0 failed
    0%     Collapse/Expand Accessors: 0 passed, 4 failed
    100%   Combine Conditionals: 4 passed, 0 failed
    76.93% Compress To/Expand From Ternary Expression: 10 passed, 3 failed
    75%    Conditional To Case: 9 passed, 3 failed
    100%   Create Method Contract: 8 passed, 0 failed
    77.28% Create Method Stub: 17 passed, 5 failed
    83.88% Create/Split Multi Variable Declaration S18736: 26 passed, 5 failed
    92.86% Create Overload: 52 passed, 4 failed
    100%   Create Setter Method: 31 passed, 0 failed
    100%   Decompose Parameter: 19 passed, 0 failed
    0%     Encapsulate Downcast: 0 passed, 3 failed
    0%     Encapsulate Field S90332: 0 passed, 32 failed
    100%   Extract Function: 20 passed, 0 failed
    0%     Extract Interface: 0 passed, 2 failed
    70%    Extract Method: 14 passed, 6 failed
    100%   Flatten Conditional: 1 passed, 0 failed
    100%   Inline Recent Assignment: 2 passed, 0 failed
    83.34% Inline Macro: 5 passed, 1 failed
    100%   Inline Result: 5 passed, 0 failed
    72.73% Inline Temporary: 8 passed, 3 failed
    53.85% Introduce Constant: 7 passed, 6 failed
    66.67% Introduce Local: 4 passed, 2 failed
    0%     Introduce Parameter Object S90333: 0 passed, 1 failed
    100%   Introduce Result Variable: 16 passed, 0 failed
    66.67% Make Method Static: 2 passed, 1 failed
    63.64% Move Initialization to Declaration: 7 passed, 4 failed
    75%    Move Method: 27 passed, 9 failed
    100%   Move Type to File: 1 passed, 0 failed
    0%     Move Type to Namespace: 0 passed, 1 failed
    100%   Promote to Parameter: 1 passed, 0 failed
    100%   Reduce Visibility: 14 passed, 0 failed
    46.16% Remove Assignments to Parameters: 6 passed, 7 failed
    100%   Remove Unused Parameters: 3 passed, 0 failed
    87.63% Rename: 85 passed, 12 failed
    77.78% Reorder Parameters: 7 passed, 2 failed
    100%   Replace Temporary with Query: 1 passed, 0 failed
    100%   Replace with Local: 1 passed, 0 failed
    0%     Reverse Conditional: 0 passed, 1 failed
    81.82% Split Initialization from Declaration: 9 passed, 2 failed
    0%     Split Temporary Variable: 0 passed, 1 failed
    61.54% Widen Scope Promote to Field: 8 passed, 5 failed

    17 Passed all tests:
     Add/Remove Block Delimiter
     Break Apart/Line Up Parameters
     Combine Conditionals
     Create Method Contract
     Create Setter Method
     Decompose Parameter
     Extract Function
     Flatten Conditional
     Inline Recent Assignment
     Inline Result
     Introduce Result Variable
     Move Type to File
     Promote to Parameter
     Reduce Visibility
     Remove Unused Parameters
     Replace Temporary with Query
     Replace with Local

    Total: 74.07% (457 passed + 160 failed = 617 total)

    The test suite http://legalizeadulthood.wordpress.com/2010/02/02/c-refactoring-tools-test-suite-available/ includes details of each test case and associated issue numbers in the devexpress bug tracker.

  • Mark Miller (DevExpress)

    Re: An Open Letter to Developer Express on the Quality of C++ Support

    2/8/2010 1:54 PM
    • Top 25 Contributor
    • Joined on 5/2/2007
    • Posts 1,335

    Hi Richard,

    Thanks for the new bugs submitted. Out of the 40 or so submitted, we've fixed about 25 so far (these fixes are available right now in a daily build you can get from support@devexpress.com). Our intention is to address all of these newly reported issues by the time we ship 10.1.

    Everyone here appreciates and shares your concern for quality, and we will continue to work hard to make CodeRush the best refactoring tool available for C++ development. Thanks for your support.

Prev 1 2
More from DevExpress
Live Chat
Have a pre-sales question?
Need assistance with your evaluation?
We are here to help.
Chat is one of the many ways you can contact members of the DevExpress Team. We are available Monday-Friday between 8:30am and 5:00pm Pacific Time.
If you need additional product information, require pre-sales assistance, or want help with your order, write to us at info@devexpress.com or call us at
+1 (818) 844-3383.