CodeRush: Unit Test Runner Preview

02 September 2009

Unit testing support is one of the most requested features for CodeRush and Mark Miller and his IDE team are hard at work on it right now. They've made great progress so I'm able to share a sneak peek with you today.

Mark wanted me to make it clear that this "Test Runner" sneak peek is very early and unfinished functionality so he and the IDE team could change any aspect of what you're about to see.

Test Runner In-source UI: More cowbell

The Test Runner consists of two parts:

  • a tool window
  • an in-editor UI

Take a look at this preview screenshot of the in-editor UI (click the image to see a larger version):

TestRunnerUIPreview 

Stay tuned – we’ll show you the Test Runner’s tool window in a future post.

If you work with NUnit then look closely at the method names and their attributes in the screenshot. Note that even the sophisticated attribute combinations using ExpectedMessage and MatchType (combinations that challenge some other unnamed test runners) are properly evaluated by the CodeRush Test Runner.

Run Test Cases

Run test cases by Ctrl+Clicking the test icon next to the test method's attributes in the editor. Keyboard shortcuts also supported.

Or run test cases from the Test Runner. We’ll post more info on the tool window UI in future posts.

image

Test Framework Support (so far)

The CodeRush Test Runner currently supports:

  • VS Test (Visual Studio’s built-in testing framework – MSDN Walkthrough)
  • MbUnit – Generative unit test framework for .NET
  • nUnit - Unit-testing framework for all .Net languages
  • Any other .NET testing framework (just about), more on this below…

The top three frameworks have built-in support by the CodeRush Test Runner and not by an external plugin. This gives you the advantage that the IDE team will support your questions, comments, and, of course, suggestions when using any of these three frameworks!

Extensibility

Extensibility is a big advantage for you. It allows you to create/edit/distribute plugins. Extensibility also creates a great ecosystem to interact and share with other developers using CodeRush.

Extensibility is one of the key features for CodeRush which is built on top of the DXCore framework. In fact, CodeRush’s extensible architecture already has a ton of great plugins available. Check out the full list of free and useful plugins on the google code site: http://code.google.com/p/dxcorecommunityplugins/wiki/PluginResources

And extensibility is also a major feature of the Test Runner. You can extend the Test Runner to support virtually any .NET testing framework using the DXCore extensibility engine.

Awesome, When Can I Get It?

The IDE team is planning to release early versions of this feature in the near future. And the CodeRush Test Runner is planned for a full release later this year in the DXperience 2009 volume 3 release.

The upcoming Test Runner looks to be a game changer for many people who’ve been anticipating this announcement. What do you think? Drop me a line below with your thoughts.

DXperience? What's That?

DXperience is a royalty-free tool suite for rapid business application development for WinForms and ASP.NET apps.

Instantly enhance your WinForms and ASP.NET apps by dropping in new feature sets encapsulated in components. DXperience contains:

  • IDE Productivity Tools - Make Visual Studio easier and more effective with IDE enhancements
    • DXCore - IDE tools extensible engine
    • CodeRush - Extensible swiss army knife of tools to make source code editing faster and easier, including code editing templates, code editing utilities (selection, navigation, clipboard), inline code visualizations and the upcoming unit test runner.
    • Refactor Pro - Code editing tools specifically geared for refactoring source code.
  • XAF - Business app framework for WinForms and ASP.NET
  • XPO – Object-relational mapping for .NET
  • Reporting - Reporting "platform" for WinForms and ASP.NET
  • UI Components for WinForms, ASP.NET, WPF and Silverlight

Try a fully-functional version of DXperience for free now: http://www.devexpress.com/Downloads/NET/

34 comment(s)
Jeff

This is a fantastic annoucement, great work guys!

While I understand the support for NUnit and MBUnit, I'm surprised that xUnit.net is not included (especially being that Brad Wilson, who is an xUnit.net co-author is a CodeRush guy).  xUnit.net has been gaining in popularity lately.  If not included, hopefully someone will extend the test runner to xUnit.net.

Cheers!

2 September, 2009
Claudio Lassala

Sweet!!! It was about time.  ;)

2 September, 2009
Gary L Cox Jr [DX-Squad]

This is very cool, I love how it informs you graphically on test status.

2 September, 2009
Twitter Trackbacks for CodeRush: Unit Test Runner Preview - The ASPx Blog - Mehul Harry's DevExpress Blog [devexpress.com] on Topsy.com

Pingback from  Twitter Trackbacks for                 CodeRush: Unit Test Runner Preview - The ASPx Blog - Mehul Harry's DevExpress Blog         [devexpress.com]        on Topsy.com

2 September, 2009
Robert Kozak

Been waiting for you guys to do something about this!

Thanks

2 September, 2009
Seth Juarez

This is wonderful news!! This is the piece that will complete the puzzle for me.

2 September, 2009
Peter Lillevold

Will you support newer versions of test frameworks? Unlike a certain competitor which supports nUnit 2.4 but fails to properly run test libraries compiled with nUnit 2.5?

2 September, 2009
Boris Bosnjak

When 2009.2 was released, I wondered "What more could DevEx possibly offer to an already fantastic suite????".  Well, apparently this!

Great work, guys!

2 September, 2009
Mark Miller (DevExpress)

Hi Peter,

We're actually testing with nUnit 2.5 right now. I have heard of problems with a competitor failing to properly support ExpectedExceptions and the MatchType parameter, and we do support those. Let me know if there is something else specific the competitor isn't supporting (markm at the devexpress domain) and we'll make sure we do.

2 September, 2009
Hermann

Awesome. I love how DevExpress always think out of the box when it comes to visualizations of code.

3 September, 2009
Kris-I

Very cool :) I'm waiting this from a long time.

3 September, 2009
Anders

I have only one issue with this (and other coderush ide visuals) and that is that they don't look as good when using a dark visual studio theme. ( www.hanselman.com/.../VisualStudioProgrammerThemesGallery.aspx )

3 September, 2009
David Arkell

Great!  Certainly looks to be a game changer from my point of view.  Thanks for making an already quality set of products.

3 September, 2009
Kevin McFarlane

I assume the Test Runner will be part of the IDETools package and that it will be included with CodeRush. What about if you just have Refactor! Pro?

3 September, 2009
Steven Vanden Broeck

Awesome !

3 September, 2009
Mehul Harry (DevExpress)

Wow, thanks y'all! Mark and the IDE team are very happy to see the community excitement build up.

3 September, 2009
Mehul Harry (DevExpress)

Anders,

@rorybecker has a post about dark themes and CodeRush which may help you:

rorybecker.blogspot.com/.../coderush-and-dark-color-schemes.html

3 September, 2009
Mehul Harry (DevExpress)

Kevin,

The CodeRush Test Runner will be part of the full CodeRush package. The full CodeRush is the best way to go since it also includes Refactor Pro.

3 September, 2009
Mark Miller (DevExpress)

Anders,

We expect 9.3 to look good with dark themes.

3 September, 2009
Joe Hendricks

I will certainly be using this! Fantastic!

4 September, 2009
Robert Fuchs

No built-in support for xUnit???

6 September, 2009
Rory Becker - DevExpress

Really .. really looking forward to this :D

6 September, 2009
Rory Becker - DevExpress

Wondering if MBUnit support will include the RowTest attribute?

haacked.com/.../row_based_testing.aspx

7 September, 2009
Henrik Brinch

*GREAT*  I absolutely loved the Resharper version of the same, but then suddenly it was removed as a free-version - ... and why would I buy Resharper.  Refactor+Code Rush are by far superior to Resharper.  Keep up the good work.

9 September, 2009
Anders

@Mehu, Not quite what I was after.

@Mark, Sounds great!

9 September, 2009
CodeRush TestRunner - Andrew Stopford's Weblog

Pingback from  CodeRush TestRunner - Andrew Stopford's Weblog

10 September, 2009
CodeRush TestRunner | I love .NET!

Pingback from  CodeRush TestRunner | I love .NET!

10 September, 2009
DotNetShoutout

Thank you for submitting this cool story - Trackback from DotNetShoutout

11 September, 2009
80s Rocker

I am looking at this for my personal use over Resharper, and thought I had heard that the test runner was already released.  I just downloaded the trial and it does not seem to be in the current release.  So my question is, when will this be available, since this could be a showstopper to me leaving Resharper since I spend quite a bit of time writing unit tests.  At least let us know about when we can expect it.  Also,will this be available to download as a separate install package so we do not need to reinstall all of CodeRush/Refactor Pro.

11 September, 2009
Mehul Harry (DevExpress)

80s Rocker,

It's expected to be released later this year when DXperience 2009 volume 3 is out. (Probably around Nov/Dec timeframe).

12 September, 2009
DotNetBurner - ASP.net

DotNetBurner - burning hot .net content

12 September, 2009
Seamus McGowan

Like many others, the lack of a test runner is a show stopper for me. TestDriven.net can fill in the gap but this offering would be so much better.

1 October, 2009
Emanuel Wlaschitz

Looks great!

Any chance we will also see this for CodeRushX? As already pointed out by someone, theres a total lack of free solutions for this now that UnitRun (now part of ReSharper) was stopped.

18 November, 2009
Refactoring Tools Review - part II - Uri Lavi

Pingback from  Refactoring Tools Review - part II - Uri Lavi

11 March, 2010

Please login or register to post comments.