Monday, March 18, 2013

Kernel-Mode Debugging in a VM using Visual Studio 2012

Introduction

This article is about how to setup Kernel-Mode debugging in a VM using Visual Studio 2012. This article will be helpful for people new to driver development that wish to create, build, deploy, and debug a simple "HelloKernel". project. 

Background 

The setup process can be divided to three parts:  

  • Setting up the Virtual Machine 
  • Setting up Visual Studio 2012 
  • Setting up your HelloKernel Project 
Each part will be explained step by step.  

How to Setup the Virtual Machine 

The Virtual Machine setup was tested on VMWare 9.0 running Windows 7 x64 OS.

  • Create a new VM, use default settings (tested on VmWare, Win7 x64)
  • Add a serial port to the VM, follow these steps:
  • Right click VM -> Settings -> Add -> Serial Port -> Output to named pipe
  • Named pipe = \\.\pipe\com_2
  • First Combobox = The end is the server
  • Second Combobox = The other end is an application
  • Connect at power on = Checked
  • Finish
  • Yield CPU on poll = Checked
  • In the VM, in an elevated Command Prompt window, enter the following commands:
    • bcdedit /debug on
    • bcdedit /dbgsettings serial debugport:2 baudrate:115200

    Read more: Codeproject
    QR: Inline image 1

    Posted via email from Jasper-Net