Clean clams by rinsing them well and placing them in a bowl filled with cold water and sprinkled with ground pepper. Let sit for 1 hour.
Meanwhile, prep your veggies and in a large pot or dutch oven, cook your bacon until crispy. Remove bacon and place on paper towel lined plate to cool. Remove most of the bacon grease, but reserve a little (at least 1/2 tablespoon) in the pot.
After the hour, scoop out clams with a slotted spoon (do not pour into a colander, sand will have rested to the bottom of the bowl), rinse again, and scrub the outside of the shells to remove any last bits.
In a large sauté pan on medium, heat olive oil and sauté garlic 1/2 of the garlic for 1 - 2 minutes. Add white wine and cook for about 2 - 3 minutes. Add clams and cover pan. Let steam for 8-10 minutes until clams are opened.
Remove clams from pan and discard any clams that have not opened. Clean clams out of shells, give a quick chop on a cutting board, and set aside.
Heat the pot you cooked your bacon and that has some bacon grease to medium. Add onions, garlic, and celery. Cook, stirring occasionally for about 6 minutes. Add potatoes, thyme, and then water +/ clam juice enough to cover all ingredients. Add 1-2 teaspoons of salt and fresh ground pepper. Bring to a boil, then simmer until potatoes are soft, approximately 20 minutes.
Once potatoes are almost tender, add clams and crumbled bacon to the pot and let simmer for another 5-10 minutes.
Season with additional salt and pepper to taste.
Serve and enjoy!