What to do with first-year asparagus?

I dug my furrow, planted the crowns and out of 20 crowns I have MAYBE 10 shoots. Some are ferning, others are only a few inches tall. Is it safe to fill in the trench? Do I wait for more to sprout? Oh the agony! I want to get this right!