I have not needed to replace this one before, but usually they should just pop right out, use a putty knife to pop it out.
Here it is for your model:
LIGHT W10876365 / AP6026365 made by Whirlpool
click.linksynergy.com
When you click the part link you will see a Question and Answer section, you can ask them there to make sure I'm right.
Jake