Rejoicing in the Lord by A. W. Pink

From here

On the other hand, there are not a few among the Lord’s people whose tendency is to go to an opposite extreme, being afraid to rejoice in the Lord lest they be guilty of presumption. They who are most painfully conscious of the sea of iniquity surging within, feel it would be hypocrisy to joy in God and sing His praises. But let it be carefully borne in mind that the same human instrument who cried, “O wretched man that I am,” penned this very exhortation. However low the true believer may sink in his feelings, however cold and barren his heart, there is still abundant cause for him to heed this injunction. He is not bidden to rejoice in his own experiences or attainments, but “in the Lord.” It is a call to the exercise of faith, of hope, of love.

Though poor in this world’s goods, though grieving the loss of loved ones, though suffering pain of body, though harassed by sin and Satan, though hated and persecuted by worldlings, whatever be the case and lot of the Christian, it is both his privilege and duty to rejoice in the Lord. He has given us abundant cause so to do: His favour, love, faithfulness, longsuffering, granting us access to the Throne of Grace, the privilege of communion with Himself (in our sorrows and trials!), the promise of an eternity of bliss in His presence—all call for gladness and praise. This exhortation to rejoice in the Lord does not mean we are bidden to cast all sorrow out of our hearts, nor are we acting contrary to its terms when we grieve over sin. Godly sorrow and holy joy are coinciding and not conflicting emotions: there is no enjoying the sweetness of the Lamb apart from the “bitter herbs” (Exo. 12:8).

- A. W. Pink