Peter Beams

Installing Windows 7 from USB Key

2011-05-27T13:05:00.001Z

I’ve got new laptop, a Toshiba Portege R700 which as usual comes with quite a lot of bundled software pre-installed. Also the version of Windows 7 installed is the 32 bit version.

I decided to put a clean install on there of Windows 7 x64 – which meant downloading all the device drivers from the Toshiba site ready to install after Windows.

To install Windows I followed this guide to install from a USB key rather than DVD. The Windows install I had was an ISO image anyway, so rather than burn it to disk just for the install using the USB key seemed like a better option. After all - optical drivers aren’t up to much, they’re slow, noisy and unreliable (well they have been for me anyway). Using the USB key worked like a treat - seemed to install quicker too and the machine didn’t sound like it was about to take off into space.

System.Messaging.MessageQueueException: Insufficient resources to perform operation.

2011-05-27T10:54:00.001Z

I came across this error today in one our web service applications:-

System.Messaging.MessageQueueException: Insufficient resources to perform operation.
   at System.Messaging.MessageQueue.SendInternal(Object obj, MessageQueueTransaction internalTransaction, MessageQueueTransactionType transactionType)
   at System.Messaging.MessageQueue.Send(Object obj, String label, MessageQueueTransaction transaction, MessageQueueTransactionType transactionType)
   at System.Messaging.MessageQueue.Send(Object obj, String label)

The service causing the error is a data import service. It collects requests received during the day into an MSMQ and then processes it overnight.

The queue of requests only had about 10 messages in it, so was unlikely to be causing any resource issues.

However, when the data import service fails to process a message overnight, it sends it to a poison queue. That queue had lots of messages in it. At the moment the poison queue is left to fill up, we only use it when we’re fixing a specific problem with the import service. Neither queue had a value set for “Limit message storage”.

It turns out that there’s a machine setting for limiting the amount of disk space given to MSMQ for storing messages. It defaults to 1GB and sure enough the C:\WINDOWS\system32\msmq\storage had 1GB of data in it and no more.

To solve it I backed up the queues using mqbkup and then purged the poison queue. I also upped the limit to 4GB so the problem occurs less often. But that’s not a real solution. Really I’d like some monitoring to tell me when the queue is approach full so that I can do something about it.

Having a dig around I found a performance counter called MSMQ Service\Total bytes in all queues. Should be able to monitor that and raise an alert when it approaches the limit.

Thanks to Ayende’s post on this one. Also there’s a more complete list of possible causes from this post (this is number 7).

Solid State Hard Drive for my developer machine

2009-08-02T19:27:00.003Z

Solid state memory that makes up USB flash drives has quite recently become a real option for use in a system hard drive. The solid state disks typically come in sizes 30GB, 60GB, 120GB and 250GB, cost spiralling the larger you go.

I’m working with a number of large .NET solutions that I have to open, build and frequently chop and change between during the day. This gets quite frustrating waiting for the HD to spin up and load all those source files to do some work. Also all the code is controlled using SVN (and TortoiseSVN as a client) – which creates loads of small hidden files which are read a lot when moving around the code.

I read the blogs by Scott Hanselman and Joe Spolsky, two well respected developers on introducing SSD for their development machines. Further reviews and benchmarks on SSD drives looked like they would be a promising option for saving time on disk access during the day. I hesitate to say an “affordable”option because a 120GB disk costs around £260.

I found a 120GB OCZ Summit series on overclockers.co.uk for £260, and got one in. The Summit series is the in the “professional” series on the OCZ website compare to the lower performing Agility series (which costs around £30 less).

The drive I’m upgrading was a 74GB Western Digital Raptor, a really good drive in its day. I’ve got another 250GB drive in my machine which as partition with the MBR and Windows XP. The raptor drive runs Vista Ultimate.

I installed the new drive onto a spare SATA channel and booted up vista. I picked Acronis Migrate Easy 7.0 to copy the contents of the Raptor over to a new 74Gb partition on the SSD drive. That would leave 50GB free for my frequent working files, like source code.

After a couple of reboots, Acronis started up and cloned the contents of the Vista drive over to the new SSD. After that I powered down and put the SSD drive on the channel where the raptor used to live.

This caused me to get an error message when trying to boot into Vista, which was solved by popping in the Vista DVD and doing a repair. I figure that is repaired something in the MBR that had gone slightly awry in the clone.

Rebooted and the system was up and running perfectly with the new drive in the old one’s place. My performance benchmarks are fairly rudimentary, timing a few long tiresome disk jobs using a stopwatch.

Boot, login and get IE to load the home page:-
Before: 2m38s, After 1m10s

Multiple .NET solution compilation:-
Before: 5m02s, After 2m22s

Visual Studio Load of a solution:-
Before: 1m46s, After 58s

From the results you can see that disk intensive things took about half as much time. Now I think that’s a good return on the investment, should save plenty of time over the coming weeks.

First play with NBehave

2008-09-10T11:24:00.003Z

I've been reading about Behaviour Driven Development and the tools around it, namely NBehave.

Behaviour Driven Development (Ok I'm going to call it BDD from here on ...) looks to be a great way of making the developer keep their focus on what their objectives are for the code their about to write. Test Driven Development (TDD) was the start of that, but it BDD takes it a step further and relates tests to the business value they're trying to achieve. I think every developer is guilty of jumping into code and forgetting where they came from or why they're there at some point.

I like code that reads closer to English, the sentence style of NBehave makes it easy to read the code and flow through and provides structure.

Dan North's article What's in a story? is a great introduction into the structure of user stories, and is worth a read even if BDD isn't something you're considering.

You can download NBehave from CodePlex and I'm using MbUnit as my testing framework, but I guess any other would work just as well.

Some Code...
Here's the source code for the quick example I wrote:-

The Test Code
Here's the testing code:-

    [Theme("Calculator"), TestFixture]
 public class Class1
 {

     [Story, Test]
     public void Should_Add_Up_Positive_Numbers()
     {
         //create the instance being used in testing
         Calc c = new Calc();
      
         //create vars for test input
         int a = 0;
         int b = 0;
      
         //create var that will have result filled
         int result = 0;

         //create the user story being tested
         Story s = new Story("Should add up positive numbers");
         s.AsA("Administrator")
             .IWant("to have numbers add up")
             .SoThat("I can get the total");

         //setup scenario conditions and post conditions
         s.WithScenario("Both numbers are positive")
             .Given("First Number is positive", delegate { a = 5; })
             .And("Second Number is positive", delegate { b = 6; })
             .When("Numbers are added up", delegate { result = c.Add(a, b); })
             .Then("Total is correct", delegate { Assert.AreEqual(11, result); });
      
     }

 }

The Production Code
Here's the production code to make the unit test pass:-

     /// <summary>
 /// Sample calculator class
 /// </summary>
 public class Calc
 {
     /// <summary>
     /// Adds the specified a to b and returns result.
     /// </summary>
     public int Add(int a, int b)
     {
         return a + b;
     }
 }

Test Output
I like way the test code reads just like a user story definition, it prints out in the test output which could be useful for creating testing reports.

------ Test started: Assembly: NBehaveTesting.dll ------

Starting the MbUnit Test Execution
Exploring NBehaveTesting, Version=1.0.0.0, Culture=neutral, PublicKeyToken=null
MbUnit 1.0.2700.29885 Addin
Found 1 tests
Story: Should add up positive numbers

Narrative:
 As a Administrator
 I want to have numbers add up
 So that I can get the total

 Scenario 1: Both numbers are positive
     Given First Number is positive
         And Second Number is positive
     When Numbers are added up
     Then Total is correct
[success] Class1.Should_Add_Up_Positive_Numbers
[reports] generating HTML report
TestResults: file:///C:/Users/peter.beams/AppData/Roaming/MbUnit/Reports/NBehaveTesting.Tests.html

1 passed, 0 failed, 0 skipped, took 2.60 seconds.

Summary
I hope this first example is useful to someone taking a look at NBehave. I'll be looking at BDD and NBehave in more detail soon, so more posts to follow. I'm sure there are some war stories of using NBehave in large projects, so I'm hunting for them!

File size limitation problem with XslCompiledTransform

2007-12-17T16:01:00.000Z

I recently ran into a problem with a reporting feature on a product we're building and was very close to release. The report was being generated by a IHttpHandler in the ASP.NET 2.0 site that would transform an XML data document to RTF using an XSLT transform. We had around 20 reports that were working fine and generating without any problems. One XSLT transform was causing some major problems that even lead to crashing the application pool in IIS 6.0 when it was running.

The handler that was supposed to be returning the report as an attachment in the request was displaying a 'Page cannot be displayed' and the System event log had warnings logged whenever this happened:-

A process serving application pool 'DefaultAppPool' suffered a fatal communication error with the World Wide Web Publishing Service. The process id was '6244'. The data field contains the error number.
For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp.
0000: 8007006d

We couldn't recreate the problem locally in Visual Studio web development server, it only seemed to be for this one report when running in Windows 2003 and IIS 6.0.

The Xslt engine being used was the standard XslCompiledTransform class in the .NET framework, the previous implementation of Xslt transforms XslTransform had been marked as obsolete - so all during development the team was working with XslCompiledTransform. The only difference we could see with the broken report and the working ones (after a while of checking and double checking other probable causes) was that the Xsl file for that report was larger (~480Kb).

The migration guide in MSDN makes no mention of there being a file size limitation when using XslCompileTransform, but we were able to find this forum post that explains the issue we were having. The problem is due to the JIT compiler for Xslt transformation running out space for declaring locals during IL compilation. The suggestion is to split the XSL into smaller transforms, but we took an alternate route and switched back to using XslTransform in the code. The older class handles the large report transformation - it might obsolete, but it works!

Building reports like this way isn't the most elegant solution, but we hit this problem late in the development cycle that it was far too late to consider switching to a different method. It's a little disappointing that MS aren't more explicit about that limitation in the migration guide.

Testing ASP.NET SOAP Web Services

2007-04-05T09:31:00.000Z

I've been developing some ASP.NET SOAP services for exposing some application logic to an associated application being developed by a colleague using Flash and Flash Media Server.

To test the SOAP calls before deploying the services ready to be consumed by Flash, I needed to test the output from the services under certain conditions.

When running the ASP.NET site from Visual Studio 2005, you can invoke the SOAP call from the browser. This is fine for testing service operations that don't take any parameters, or parameters that primitive types (like strings and integers). If the operation takes a complex type like an instance of a class you've written or complex .NET type like System.Guid - they you can't invoke them this way.

You could write a consumer application for web methods that can't be executed from the browser, but that means there's more code to write - and I'd rather see the service working outside of .NET to assure me that it will do the job for the Flash and Flash Comms Server parts of the application.

soapUI is a free and open source java based SOAP tester that allows you to prod and poke a web service with relative ease. Its available as a standalone java app, or as a plug-in to popular tools like Eclipse. I downloaded and installed the java installer from soapUI SourceForge Project.

To test the service you just need to point soapUI to the WSDL description for the service you want to test. ASP.NET generates that document for you so the URL looks something like http://myServer/myService.asmx?wsdl. soapUI then uses the WSDL to give you a template for a SOAP request where you can fill in the data values you want to test with.

After that's done, hit the Submit option and the response from the service is displayed in the right hand pane. It's complete with the SOAP headers and the data that's been returned. If there's an exception thrown by the service call, then the exception will be displayed instead.

Later on I'll need to set up some unit tests and regression tests for the services, but soapUI is a great tool for doing the ad-hoc testing I need at the moment.

Wiki Log book

2007-03-28T16:07:00.001Z

Last week I downloaded and setup MediaWiki on my local development machine. As the MediaWiki site will tell you it runs using PHP extensions for IIS and is powered by MySQL database - both tools that can run along side my .NET development environment without causing conflict. My original reason for downloading and installing it was to evaluate how hard it would be to deploy / adapt for one of our clients that might require a Wiki site later in the year. I have, however, found having a Wiki running locally to be a valuable tool while I develop.

One of the core challenges of software development has always been keeping useful and current documentation. It always seems to be one of the first parts of a project that is dropped when a deadline gets tight, if was even included in the first place. With the Wiki running, I can keep it open as I write code so that I can add to my high level documentation as I'm going. Writing documentation as you go is bound to make it more accurate and useful to other developers that might have to pick up your work.

My advice... throw away all those scraps of paper on your desk, and even that notebook (if its like mine it hasn't been touched for a few weeks anyway - who uses pens these days?) .. And install MediaWiki today!

CasperXP for cloning disk

2007-02-06T20:32:00.000Z

I've come across a good tool for backing up bootable hard disks - CasperXP [http://www.fssdev.com/products/casperxp/] will create an exact clone of a hard disk partition to another partition of the same size, including boot sectors. What that means is that if your main hard disk partition fails or corrupts then you change the bootable disk in the BIOS, and away you go working with a recent clone of your OS and programs. It costs $50 at my last check, and is worth the price tag if it saves a days work of rebuilding my system.

This could all be achieved by using a RAID array of disks with one of the parity of clone RAID setups. That though would be expensive and wouldn't work on a partition to partition basis like CasperXP does.

WPF/E ... Adobe vs Microsoft?

2007-01-18T07:55:00.000Z

Microsoft Channel 9 have posted a video interview with Scott Gu where they run through using WPF/E and AJAX, IIS 7.0 and a couple of the other emerging technologies from Microsoft.

Looking through the WPF/E documentation and reading the general buzz about it, first question that entered my head (and it was always going to be). What does WPF/E stand for? WPF is a product that's been bounded around during the development of Vista (previously codenamed "Avalon" I think) and stands for Windows Presentation Foundation ... but where has this new E come from? Apparently it stands for "Everywhere", Microsoft developing something truly cross platform? Surely Not!

I downloaded the CTP release of the WPF/E; Looking through some of the online demos on Mike Harsh's Blog, I couldn't really see anything new to the user experience that wasn't possible using Adobe (formally Macromedia) products like Flash. I think however most of the benefits from using WPF/E will come from the portability of code because it uses XAML, and its integration with AJAX for doing data post backs to webserivces.

WPF is the new UI layer that ships in Vista and is driven by XAML (an XML format for describing user interface designs). XAML itself is a good move away from having to, in code, declare controls and their layout, look and design. It effectively provides that layer of abstraction of UI from UI functionality, like we've been used to with ASP.NET over the last few years.

Recently its becoming clear that Microsoft are Adobe are going head to head in some of their developing product lines for delivering cross platform rich user interfaces over the web.

The WPF/E technology is certainly comparable to Flash Player, or Adobe Flex. That's made a little more evident by there being a tool swfToXAML for converting Flash movies to XAML markup.

Not available in this version of the WPF/E CTP, Scott Gu says that the final release will have better video support, with things like live streaming for things like conferencing. I'm yet to develop anything meaningful in either WPF/E or Flex, but I'm keen to see what benefits / advantages of using them practically.

SVN and Trac

2007-01-16T16:32:00.001Z

Since Vista has put an end to me using the Cisco VPN for now, I can't get access to Source Safe in the office for checking source code in and out from my main development machine.

The project I'm working on at the moment does really need checking into the master source safe database for now until I've finished working on it - so it's given me an opportunity to try out some other source control systems.

Dave Griffiths [http://www.davegriffiths.net/] put me onto a system called Trac which gives a web interface for SVN repositories. I signed up for a developer account on www.svnrepository.com, it costs just under $4 for 500Mb of SVN storage, and they run Trac.

To access the repository from my development machine, I've downloaded TortoiseSVN [http://tortoisesvn.tigris.org/] client for windows that allows access to my SVN db from Windows Explorer.

So far I'm impressed with this setup. SVN doesn't need a lock to be gotten (though you could if it was needed) on the file before it can be worked on, and the merging functions are good from what I've seen. Trac also has bug tracking, Wiki, Timeline and Roadmap functionality. I'll be branching out into using these in the next couple of days.

I think SVN works with code generation, code sets are a better way working than labelling. I'm going to try to figure out a way that all this can work that makes sense - Code Generation / Database Deployment / Build Server / Source Control.

Watch this space!

Vista So Far...

2007-01-13T13:50:00.000Z

I've been using Vista Bussiness for a few days now, so I'd thought I'd report my findings so far.

The postives...

I'm enjoying using Vista so far. It looks better (though I know the novelty will wear off soon enough) and the side bar is great when you get some RSS feeds in there.

I'm using a dual monitor setup, and one of the things that used to annoy me in XP was that videos would stop playing when you moved them from screen to screen in PowerDVD or media player, Vista seems to have it sorted. I think they must have improved dramatically the way the videos are rendered because they even play when your cycling through applications using Alt+Tab and in the little window previews you get when hovering over something in the start bar, something that wasn't possible in XP.

The negatives...

To connect into the office I downloaded and installed the Cisco VPN client beta version for vista from http://vpnclient.clearchannel.com/. I haven't been able to get it running, its not a problem with the networks at either end it worked before using the same hardware and XP on my machine. When the VPN client tries to connect, it site there for a while and then returns the message "The remote peer is no longer responding". I've heard reports of other people using the Vista Cisco VPN client without problems on Vista, so looks like I need to have a dig around to find the fault.

I'm also running VMware to host a couple of virtual images of Windows XP on my machine, the only problem I've had running it in Vista so far has been using the clients with "Bridged Network" mode. When I bring up the Network Settings in the VMware manager, the OK button was disabled. That turned out to be a problem with security in Vista - I got round it my adding the _vmware_ user to the adminsitrators group in Computer Mangement, and running the VMware manager as administrator. When the virtual machine boots up, it just reports the Vmware network connection has limited connectivity. Could be a problem with DCHP and the service that VMware creates to give the Virtual Machines IPs. However, I can still get online using machines in NAT mode, so its not a huge problem for now.

Taking the vista plunge...

2007-01-10T11:21:00.000Z

I've just taken the plunge and installed Vista Business on my PC. I do most of my work through VMware virtual machines, so that would reduce the risk of sticking a new operating system on and then not being able to do any work.

After doing triple checks that I'd backed up all my "must have" data, I popped in the install disk that I'd burnt and followed through the install. All in all it was a much painless process than installing XP from fresh (but maybe I'm being blinded by the swish new graphics in the install), and I think it was a little quicker.

The first part that confused me was when I was asked what version I wanted to install. I get a license of Business version through the university so that's what I needed to select. However there was a "BusinessN" version in the list - unsure what it was I avoided it. Reading up on it this morning it sounds like the only difference is the N version ships without Windows Media Player installed - a knock on of the EU legal battle with Microsoft recently I think.

After I had created myself a user account I logged in I was presented with a "Welcome to Vista" screen. The system details listed the system as being a 32-bit intall of Vista, I'd read that there was no separate install disks between 32 and 64 bit version for Vista. My PC's got a AMD 64 X2 4200+, so was hoping that it would have detected it and installed the 64 bit version. I was never asked in the install setup whether I wanted 32 or 64, so maybe my CPU isn't compatable (or marked as compatible in the BIOS)? Something I'm going to look into over the next couple of days.

Had some work to do to get my machine online too. My PC is using a NetGear WG111 54G wireless dongle which has no supported Vista drivers (and as far as I know no plans for Netgear to write any). At the moment I've borrowed my flatmate's WG111v2 and I'm using the Vista Beta driver from Netgear. That dropped in fine after doing a "Have Disk.." driver install through device manager. I've had to put in IPs and DNS server IPs manually, didn't seem to pick them up automatically from the wireless router. Ah well, I can live with that ... it works!

My collegues who had installed Vista had warned that it blocks unsigned drivers from being installed - not something that I've found on my install. Maybe because I'm using Business edition, and I've been doing "Have Disk..." installs for drivers.

My Wacom tablet still needs a bit of work to get it running, looks like Vista ships with drivers for pen tablets which are conflicting with the Wacom drivers. Haven't found a way to set up absolute referencing with the windows ones (where the tablet space maps directly to the screen), so might need to do some turning off and use the Wacome ones exclusively.

That's about it for now - more to come later with my trials and tribulations with Vista (and developing it in)