Whitby’s first library was officially formed in 1852. Known as the Mechanic's Institute (MI), the library was a member’s only institution with the goal of educating the working men of the community. It was located on the corner of Mary and Byron Streets and included a hall for lectures in addition to a library. The first librarian was Hugh Fraser, a volunteer established a vast collection of books. The membership fee was $1.00 annually which meant that only wealthier men of Whitby had access to the resources of the MI.

On November 27, 1873, the building and all its books (1300-1400 volumes) were destroyed by fire. The MI eventually acquired new books for the collection and by 1880 was located in the second floor of the Oddfellow's Hall at 103-107 Brock Street North.

When Hugh Fraser died in 1890, the officers of the MI appointed his daughter, Mary Fraser as the head librarian. Her appointment reflected a necessary evolution for the MI. Prior to the fire in 1873, interest in the Mechanic's Institute by the men of the community waned. There were only 60 paying members and executive positions were often vacant. During the 1880s and after Mary Fraser's appointment, the MI became more involved in the education of Whitby students and the hall was opened to the community. More importantly, women were allowed to become members and they could use the space for lectures and meetings.

As library collections grew, it was apparent the MI required more space to serve the community. In 1911, the Town of Whitby began investigating other options for a library.