Blogs

Mark Miller

The Extensible Test Runner You’ve Been Waiting For

We’ve been hard at work fine-tuning the CodeRush Test Runner, and we’re getting excited.

This screen shot contains a few clues as to why we’re so pumped up:

 FirstShot

We’re pleased with the UI. Notice in the screen shot above how failing tests are easy to spot while the less-important information is rendered in a lower contrast that’s easy on the eyes. Also, we’ve done some work on the tree list to reduce the number of clicks needed to get to tests of interest. And there’s a handy filter text box at the top.

So it looks pretty. But more importantly, the Test Runner supports all the popular testing frameworks right out of the box, including VSTest, NUnit (including different flavors mixed in with various extensions), and the oft-neglected xUnit and MbUnit. The screen shot above is taken from a solution that includes test cases for all of these frameworks.

CodeRush customers will also receive full source code to the plug-ins we ship that provide all this luscious unit testing support. So if you want to extend support for any of these unit test frameworks, it’s easy. Or if you want to add support for a brand new unit testing framework, you all have the sample code you need to get started. That is cool.

Test results also appear in the code:

 TestStatus

You can run test cases from the Test Runner, or from the code itself by clicking one of the Test Runner icons that appear next to the unit test attributes (as shown in the screen shot above).

The Test Runner debuts in CodeRush 9.3 (beta is internal testing and will available soon if not already by the time you read this). I’ll be showing the Test Runner at PDC in Los Angeles this week, so if you’re in LA stop by our booth and check it out.

Published Nov 16 2009, 01:36 PM by
Bookmark and Share

Comments

Tolis Bekiaris [DX-Squad]

Nice look!! but I am concern more on staying away of mouse, how the addin is doing on that area? How easy is to see the error and go to error line? And one more whats its speed comparing to others?

November 16, 2009 6:38 PM

Me

I want it.  Now. :-)

November 16, 2009 6:49 PM

uberVU - social comments

This post was mentioned on Twitter by MillerMark: The extensible Test Runner you've been waiting for: http://is.gd/4WDvR

November 16, 2009 7:18 PM

Steve Bohlen

Very nice -- looks like a great start and kudos for the wide support of (most) all of the most common .net test frameworks out of the box.

Can't wait to get my hands on this thing!

November 16, 2009 7:37 PM

Boris Bosnjak

I'm gobsmacked!  Gobsmacked I tell you! :D

November 16, 2009 8:23 PM

olcay şeker

can this test runner support Rhino.Mocks???

November 16, 2009 8:56 PM

Steven Vanden Broeck

YAY !

November 17, 2009 2:24 AM

Christophe Kamieniarz

I was waiting it for more than 2 years. Can wait for 2 more days, but no more than that. Pleasssssssse, release 9.3 beta!!! ;)

November 17, 2009 7:27 AM

Dew Drop – November 17, 2009 | Alvin Ashcraft's Morning Dew

Pingback from  Dew Drop – November 17, 2009 | Alvin Ashcraft's Morning Dew

November 17, 2009 8:19 AM

Claus Bogner

> I want it.  Now. :-)

Me too!!!!

November 17, 2009 11:25 AM

Steven Vanden Broeck

Yay !

When and where can we download the beta ?

November 17, 2009 1:23 PM

Michael Hedgpeth

I'm concerned the "stand out" failure icon would not be as nice if one was doing TDD and seeing failures all the time.

November 18, 2009 3:37 PM

Stephen Brouillard

Looks like FANTASTIC STUFF!  One quick question.  Will this work with the Silverlight Testing Framework?

November 19, 2009 9:11 PM

Aaron Smith

This is awesome... But I can't use it because CR is not in VS 2010 yet. :(

Can't wait to try it though!

November 19, 2009 9:47 PM

Jeremy McGee

Looks lovely, and the pass/fail indicator in the source looks really useful.

I see the competition here is TestDriven.NET, which is a very clever piece of work. That doesn't just work with the test frameworks mentioned but also includes test-with-debugger and test-with-coverage. Test-with-coverage works with NCover which is otherwise quite tricky to get going.

November 20, 2009 1:36 AM

Emanuel Wlaschitz

Any chance we'll see this with CodeRushX?

Unfortunately, there are no free Test runners that integrate nicely with the IDE, especially since ReSharper UnitRun was discontinued and integrated with ReSharper itself...

November 20, 2009 2:03 AM

Daniel Gilleland

Looking forward to this! It'll make a great early Christmas present to all use devoted DevExpress users! (hint, hint)  :)

November 20, 2009 10:13 PM

W.Meints

Can't wait to get my hands on the goods. Nice stuf!!

November 30, 2009 10:08 AM

Dan Pupek

Great new feature but one very major problem we have noticed. It doesn't run the [SetUpFixture] setup and teardown when running individual tests. (Nunti 2.5)

TestDriven.Net does. Also, I'd like to be able to configure more about the test runners. Otherwise it's looking good.

December 28, 2009 2:56 PM

Mark Miller (DevExpress)

Hi Emily,

This is fixed for the 10.1 release and is available right now in a daily build.

January 11, 2010 2:12 PM

About Mark Miller (DevExpress)

Mark Miller is a C# MVP with strong expertise in decoupled design, plug-in architectures, and great UI. Mark is Chief Architect of the IDE Tools division at Developer Express, and is the visionary force behind productivity tools like CodeRush and Refactor!, as well as the DXCore extensibility layer for Visual Studio. Mark is a popular speaker at conferences around the world and has been writing software for over two decades.
LIVE CHAT

Chat is one of the many ways you can contact members of the DevExpress Team.
We are available Monday-Friday between 7:30am and 4:30pm Pacific Time.

If you need additional product information, write to us at info@devexpress.com or call us at +1 (818) 844-3383

FOLLOW US

DevExpress engineers feature-complete Presentation Controls, IDE Productivity Tools, Business Application Frameworks, and Reporting Systems for Visual Studio, along with high-performance HTML JS Mobile Frameworks for developers targeting iOS, Android and Windows Phone. Whether using WPF, Silverlight, ASP.NET, WinForms, HTML5 or Windows 8, DevExpress tools help you build and deliver your best in the shortest time possible.

Copyright © 1998-2014 Developer Express Inc.
All trademarks or registered trademarks are property of their respective owners