Captain Penniman’s whaling ships produced 4,237 barrels. of sperm oil, 12,096 barrels. of whale oil, and 166,871 pounds of whalebone. This made him a very rich man and he built this house in 1868 near Fort Hill at the end of the Victorian Age and styled after the French Second Empire.