What does this poem mean "the apology"???

to me , it sounds like the person is apologizing for wandering off contemplating deep thoughts, while others are toiling away at physical labor,,,,,, he/she is saying that each thing they see/hear/touch, is bringing revelations to them,,,, it seems like the person has been doing this for a long time,,,,, threw two harvests