You can do this in three simple steps. Step 1: Loosen the Soil: To remove small rocks from your yard, farm, or garden, begin by using a rototiller to loosen the soil, break up the dirt, and turn up stones, rocks, and pebbles. Step 2: Rake and Pile: After rototilling the soil, use a heavy-duty garden rake, beach rake, or rock rake to pull away ...