CodeRush: Unit Test Runner Preview

Unit testing support is one of the most requested features for CodeRush and Mark Miller and his IDE team are hard at work on it right now. They've made great progress so I'm able to share a sneak peek with you today.

Mark wanted me to make it clear that this "Test Runner" sneak peek is very early and unfinished functionality so he and the IDE team could change any aspect of what you're about to see.

Test Runner In-source UI: More cowbell

The Test Runner consists of two parts:

  • a tool window
  • an in-editor UI

Take a look at this preview screenshot of the in-editor UI (click the image to see a larger version):

TestRunnerUIPreview 

Stay tuned – we’ll show you the Test Runner’s tool window in a future post.

If you work with NUnit then look closely at the method names and their attributes in the screenshot. Note that even the sophisticated attribute combinations using ExpectedMessage and MatchType (combinations that challenge some other unnamed test runners) are properly evaluated by the CodeRush Test Runner.

Run Test Cases

Run test cases by Ctrl+Clicking the test icon next to the test method's attributes in the editor. Keyboard shortcuts also supported.

Or run test cases from the Test Runner. We’ll post more info on the tool window UI in future posts.

image

Test Framework Support (so far)

The CodeRush Test Runner currently supports:

  • VS Test (Visual Studio’s built-in testing framework – MSDN Walkthrough)
  • MbUnit – Generative unit test framework for .NET
  • nUnit - Unit-testing framework for all .Net languages
  • Any other .NET testing framework (just about), more on this below…

The top three frameworks have built-in support by the CodeRush Test Runner and not by an external plugin. This gives you the advantage that the IDE team will support your questions, comments, and, of course, suggestions when using any of these three frameworks!

Extensibility

Extensibility is a big advantage for you. It allows you to create/edit/distribute plugins. Extensibility also creates a great ecosystem to interact and share with other developers using CodeRush.

Extensibility is one of the key features for CodeRush which is built on top of the DXCore framework. In fact, CodeRush’s extensible architecture already has a ton of great plugins available. Check out the full list of free and useful plugins on the google code site: http://code.google.com/p/dxcorecommunityplugins/wiki/PluginResources

And extensibility is also a major feature of the Test Runner. You can extend the Test Runner to support virtually any .NET testing framework using the DXCore extensibility engine.

Awesome, When Can I Get It?

The IDE team is planning to release early versions of this feature in the near future. And the CodeRush Test Runner is planned for a full release later this year in the DXperience 2009 volume 3 release.

The upcoming Test Runner looks to be a game changer for many people who’ve been anticipating this announcement. What do you think? Drop me a line below with your thoughts.

DXperience? What's That?

DXperience is a royalty-free tool suite for rapid business application development for WinForms and ASP.NET apps.

Instantly enhance your WinForms and ASP.NET apps by dropping in new feature sets encapsulated in components. DXperience contains:

  • IDE Productivity Tools - Make Visual Studio easier and more effective with IDE enhancements
    • DXCore - IDE tools extensible engine
    • CodeRush - Extensible swiss army knife of tools to make source code editing faster and easier, including code editing templates, code editing utilities (selection, navigation, clipboard), inline code visualizations and the upcoming unit test runner.
    • Refactor Pro - Code editing tools specifically geared for refactoring source code.
  • XAF - Business app framework for WinForms and ASP.NET
  • XPO – Object-relational mapping for .NET
  • Reporting - Reporting "platform" for WinForms and ASP.NET
  • UI Components for WinForms, ASP.NET, WPF and Silverlight

Try a fully-functional version of DXperience for free now: http://www.devexpress.com/Downloads/NET/

Jeff

This is a fantastic annoucement, great work guys!

While I understand the support for NUnit and MBUnit, I'm surprised that xUnit.net is not included (especially being that Brad Wilson, who is an xUnit.net co-author is a CodeRush guy).  xUnit.net has been gaining in popularity lately.  If not included, hopefully someone will extend the test runner to xUnit.net.

Cheers!

2 September, 2009

Sweet!!! It was about time.  ;)

2 September, 2009

This is very cool, I love how it informs you graphically on test status.

2 September, 2009

Pingback from  Twitter Trackbacks for                 CodeRush: Unit Test Runner Preview - The ASPx Blog - Mehul Harry's DevExpress Blog         [devexpress.com]        on Topsy.com

2 September, 2009

Been waiting for you guys to do something about this!

Thanks

2 September, 2009

This is wonderful news!! This is the piece that will complete the puzzle for me.

2 September, 2009

Will you support newer versions of test frameworks? Unlike a certain competitor which supports nUnit 2.4 but fails to properly run test libraries compiled with nUnit 2.5?

2 September, 2009
Boris Bosnjak

When 2009.2 was released, I wondered "What more could DevEx possibly offer to an already fantastic suite????".  Well, apparently this!

Great work, guys!

2 September, 2009

Hi Peter,

We're actually testing with nUnit 2.5 right now. I have heard of problems with a competitor failing to properly support ExpectedExceptions and the MatchType parameter, and we do support those. Let me know if there is something else specific the competitor isn't supporting (markm at the devexpress domain) and we'll make sure we do.

2 September, 2009
Hermann

Awesome. I love how DevExpress always think out of the box when it comes to visualizations of code.

3 September, 2009

Very cool :) I'm waiting this from a long time.

3 September, 2009
Anders

I have only one issue with this (and other coderush ide visuals) and that is that they don't look as good when using a dark visual studio theme. ( www.hanselman.com/.../VisualStudioProgrammerThemesGallery.aspx )

3 September, 2009

Great!  Certainly looks to be a game changer from my point of view.  Thanks for making an already quality set of products.

3 September, 2009

I assume the Test Runner will be part of the IDETools package and that it will be included with CodeRush. What about if you just have Refactor! Pro?

3 September, 2009

Awesome !

3 September, 2009

Wow, thanks y'all! Mark and the IDE team are very happy to see the community excitement build up.

3 September, 2009

Anders,

@rorybecker has a post about dark themes and CodeRush which may help you:

rorybecker.blogspot.com/.../coderush-and-dark-color-schemes.html

3 September, 2009

Kevin,

The CodeRush Test Runner will be part of the full CodeRush package. The full CodeRush is the best way to go since it also includes Refactor Pro.

3 September, 2009

Anders,

We expect 9.3 to look good with dark themes.

3 September, 2009

I will certainly be using this! Fantastic!

4 September, 2009

No built-in support for xUnit???

6 September, 2009

Really .. really looking forward to this :D

6 September, 2009

Wondering if MBUnit support will include the RowTest attribute?

haacked.com/.../row_based_testing.aspx

7 September, 2009

*GREAT*  I absolutely loved the Resharper version of the same, but then suddenly it was removed as a free-version - ... and why would I buy Resharper.  Refactor+Code Rush are by far superior to Resharper.  Keep up the good work.

9 September, 2009
Anders

@Mehu, Not quite what I was after.

@Mark, Sounds great!

9 September, 2009

Pingback from  CodeRush TestRunner - Andrew Stopford's Weblog

10 September, 2009

Pingback from  CodeRush TestRunner | I love .NET!

10 September, 2009

Thank you for submitting this cool story - Trackback from DotNetShoutout

11 September, 2009

I am looking at this for my personal use over Resharper, and thought I had heard that the test runner was already released.  I just downloaded the trial and it does not seem to be in the current release.  So my question is, when will this be available, since this could be a showstopper to me leaving Resharper since I spend quite a bit of time writing unit tests.  At least let us know about when we can expect it.  Also,will this be available to download as a separate install package so we do not need to reinstall all of CodeRush/Refactor Pro.

11 September, 2009

80s Rocker,

It's expected to be released later this year when DXperience 2009 volume 3 is out. (Probably around Nov/Dec timeframe).

12 September, 2009

DotNetBurner - burning hot .net content

12 September, 2009

Like many others, the lack of a test runner is a show stopper for me. TestDriven.net can fill in the gap but this offering would be so much better.

1 October, 2009

Looks great!

Any chance we will also see this for CodeRushX? As already pointed out by someone, theres a total lack of free solutions for this now that UnitRun (now part of ReSharper) was stopped.

18 November, 2009

Pingback from  Refactoring Tools Review - part II - Uri Lavi

11 March, 2010

Please login or register to post comments.