Pre-heat oven to 400°F. Wash and scrub baby potatoes, then slice them in halves.
Place potatoes in a large mixing bowl, add olive oil, garlic, thyme, salt and black pepper. Toss to evenly coat . Lightly grease a baking sheet, then place potatoes face side down (skin side up). Don't overlap.
Bake for 20 minutes, then flip potatoes over, and bake for another 10-20 minutes. Check at the 10 minute mark, if potatoes are tender when pierced with a fork, it is done.