Only I discern Infinite passion, and the pain Of finite hearts that yearn.

The infinite is contained within the finite, just as the name implies: In finite.

Attempting to contain the infinite within finite symbolism of language may result in scholarship, but it will not produce devotion. (110)

Only I discern Infinite passion, and the pain Of finite hearts that yearn.

In heaven I yearn for knowledge, account all else inanity; On earth I confess an itch for the praise of fools - that's vanity

Our knowledge can only be finite, while our ignorance must necessarily be infinite.