http://www.sacred-texts.com/bib/lbob/index.htm

This is a collection of New Testament Apocrypha, including many works which were admired and read by the early Christians, but which were later excluded from the canonical Bible. It includes accounts of the young Jesus, particularly the Gospel of Mary and the Protevangelion, which provides additional folklore about the birth and youthful adventures of Jesus. Of note are the letters of Paul and Seneca, and the letters of Herod and Pilate, which are most likely a forgery, but add more depth to the question of the historicity of Jesus. There are also a number of non-canonical epistles, such as Laodiceans. Also worth a close read are the three books of the Shepherd of Hermas, which uses apocalyptic and symbolic imagery. This collection is an invaluable selection of portions of the New Testament which illustrates the fluid nature of the early Biblical canon, and provides access to all of the 'spare parts.'--J.B. Hare, August 12, 2009.

At the link above, links to texts of all these books can be found:

The Gospel of the Birth of Mary
The Protevangelion
The First Gospel of the Infancy of Jesus Christ
Thomas's Gospel of the Infancy of Jesus Christ
The Epistles of Jesus Christ and Abgarus King of Edessa
The Gospel of Nicodemus, Formerly Called the Acts of Pontius Pilate
The Apostles’ Creed
The Epistle of Paul the Apostle to the Laodiceans
The Epistles of Paul the Apostle to Seneca, with Seneca's to Paul
The Acts of Paul and Thecla
The First Epistle of Clement to the Corinthians
The Second Epistle of Clement to the Corinthians
The General Epistle of Barnabas
The Epistle of Ignatius to the Ephesians
The Epistle of Ignatius to the Magnesians
The Epistle of Ignatius to the Trallians
The Epistle of Ignatius to the Romans
The Epistle of Ignatius to the Philadelphians
The Epistle of Ignatius to the Smyrnćans
The Epistle of Ignatius to Polycarp
The Epistle of Polycarp to the Philippians
The Shepherd of Hermas
The Second Book of Hermas, Called His Commands
The Third Book of Hermas, Which Is Called His Similitudes
Letters of Herod and Pilate
The Lost Gospel According to Peter

http://www.sacred-texts.com/bib/lbob/index.htm