Heat the oil in a large soup pot over a medium-high heat. Add the back bacon, onions and celery. Cook, stirring occasionally, until the vegetables begin to soften, about six minutes. Add the potatoes, clams, clam juice, thyme and water, to cover.
Bring to a boil, and simmer until potatoes are soft, about 30 minutes.
Season with salt and pepper and serve.