How to use setPixel with HSV instead of RGB?

Question

Bitmap bmap = new Bitmap(B2);

int width = bmap.Width;
int height = bmap.Height;

for (int y = 0; y < height; y++)
{
    for (int x = 0; x < width; x++)
    {
        Color c = bmap.GetPixel(x, y);
        float h, s, b;
        h = c.GetHue();
        s = c.GetSaturation();
        b = c.GetBrightness();
    }
}

I wanted to filter out all the shades of yellow and then change it all to white. Then I have use HSB which makes it easier. Do I have to convert them back to RGB in order to use setPixel?