The History of Rhinecliff, NY

Perched on a bluff above the Hudson River, the hamlet of Rhinecliff, New York has borne witness to three and a half centuries of American history — from Dutch settlement and Livingston family dominion to railroad booms, Gilded Age grandeur, and a quiet twenty-first-century renaissance.

Table of Contents

Long before it was called Rhinecliff, the community now occupying the western edge of the Town of Rhinebeck had a different name altogether: Kipsbergen. In 1686, five Dutch settlers — among them Hendrikus and Jacobus Kip — crossed the Hudson River from Kingston, on the western bank, and established a new settlement along the eastern shore. They acquired approximately 2,200 acres with four miles of river frontage, purchasing the land from three members of the local Sepasco tribe. The location was shrewdly chosen: situated at a natural transportation crossroads, it commanded the river crossing to Kingston, sat at the southern end of an ancient trail that led east into New England, and offered the Landsman Kill stream to the south as a source of waterpower for mills.

The settlement took the name Kipsbergen from its founding family. Jacob Kip, one of the original patentees, soon established an informal ferry service to Kingston — reputedly consisting at first of little more than a hollowed-out log propelled by oars and sail. This river crossing would prove to be the economic lifeblood of Kipsbergen for nearly three centuries. The Kip family, through successive generations and marriages into the Cantine, Radcliffe, and Sleight families, would control the Kingston ferry until the arrival of the railroad in 1851 — a remarkable 168 years of continuous family involvement in a single business.

In the early eighteenth century, a powerful neighbor arrived: Henry Beekman, a businessman from New York, acquired land surrounding Kipsbergen and developed it with tenant farmers, including thirty-five German Palatine families he imported in 1716 to work his holdings. But Kipsbergen’s riverside residents — freeholders with direct commercial ties to Kingston — developed largely apart from Beekman’s inland domain. As one local history puts it, it was simply easier to take the ferry across the river than to hike up the steep bluff to the Palatine settlements above. Kipsbergen maintained its own social gravity: river-oriented, Kingston-connected, and distinct from the farming communities developing farther inland.

The Livingston Shadow and the Age of Great Estates

The mid-eighteenth century brought seismic changes to Kipsbergen’s social landscape. When Henry Beekman died and his patrimony passed to his sole heir, Margaret Beekman Livingston — already one of the wealthiest women in New York — the fortunes of the surrounding countryside were transformed. Margaret’s inheritance merged with the vast Livingston family holdings of Clermont Manor, creating a concentration of landed power that shaped the entire Hudson Valley for generations. Three of her daughters received riverfront properties carved from the old Kipsbergen tract, establishing the estates of Linwood, Wildercliff, and Ellerslie along the bluffs above the river.

Wildercliff, built in 1799 by the Reverend Freeborn Garrettson — an early Methodist circuit rider — and his wife, Catherine Livingston, became a center of Methodist activity in the region. The estate was situated on land from the original Kipsbergen patent. Ellerslie, to the south, passed through several owners before being purchased in 1842 by William B. Kelly, who transformed it into a 1,000-acre farm featuring a prize herd of Guernsey cattle. Linwood, associated originally with Margaret Livingston and Thomas Tillotson, completed the grand riverside trio. These estates, together with a dozen others established in subsequent decades, would eventually form the core of the Hudson River Historic District — today the largest National Historic Landmark designation in the contiguous United States, covering 34.6 square miles and 1,869 historically significant structures.

The riverside hamlet itself remained a working community of shippers, traders, and ferry operators throughout this era — socially distinct from both the estate gentry above the bluffs and the farming and professional classes in the village of Rhinebeck, two miles to the east. It was a community defined by the river and the road across it, not by land ownership or social standing.

The Railroad Arrives: Russell, Veitch, and the Birth of ‘Rhinecliff,’ 1851–1861

The event that transformed Kipsbergen most dramatically was the arrival of the railroad. The Hudson River Railroad opened its Rhinebeck station in 1851 at Slate Dock, but the following year it was relocated south to Shatzell’s Dock — the result of a dispute between the railroad and the Russell brothers over the ferry connection to Kingston. Charles Handy Russell, a real estate developer who had also purchased the Kip family’s ferry business, saw opportunity in the chaos. He bought the Schatzel farm, laid out a grid of streets across its steep slopes and swampy lowlands, moved the relocated ferry terminal to coordinate with train arrivals, and set about creating an entirely new village around the station.

Russell’s first attempts at naming the hamlet failed to catch on. He tried Shatzellville, then Boormanville — after James Boorman, president of the railroad — but was firmly advised that neither name would attract buyers. It was George Veitch, Russell’s architect and builder, who invented the name that stuck: ‘Rhinecliff,’ a combination of Rhinebeck and the nearby riverside cliffs. The name was considered slightly silly by inland residents, who resented that the railroad stop wasn’t simply called Rhinebeck, but Rhinecliff it remained. Contrary to a persistent local legend, the hamlet was not named after the nearby Wyndcliffe estate, which was never formally called ‘Rhinecliff’ — it was the other way around: Edith Wharton referred to the estate by the hamlet’s name in her writings, inadvertently fueling the confusion.

Veitch — who also designed the Episcopal Church of the Messiah in Rhinebeck and, later, the landmark 1914 train station building — set about constructing the hamlet’s key infrastructure. The Rhinecliff Hotel opened around 1855 as a rooming house serving ferry and railroad passengers. A Methodist and an Episcopal church followed. Three grammar schools were established. A post office opened, and in 1861 was officially renamed Rhinecliff. Russell coordinated his new ferry operation — now called the Rhinebeck and Kingston Ferry Company, managed by Thomas Cornell of Kingston — so that ferry sailings met every arriving train, making Rhinecliff a seamless transit hub where a passenger could step off a New York City train and board a waiting ferry to Kingston in minutes.

Gilded Age Prosperity: The Ferry, the Railroad, and the Violet Capital

Through the second half of the nineteenth century, Rhinecliff hummed with transportation-driven prosperity. The Kingston ferry — which had evolved from a hollowed log to horse-powered paddle boats to steam-powered vessels — was now a critical commercial artery. In 1842, the Knickerbocker became the first steam ferry on the route. Later came the Lark, built for breaking winter ice, and the steel-hulled Transport in 1881, which would remain in service for more than fifty years. The railroad brought not only local passengers but long-distance travelers on their way from New York to Albany, Buffalo, Chicago, and points west. Through Pullman sleepers and express trains, Rhinecliff became an atmospheric waypoint on journeys that spanned a continent.

The hamlet’s commercial role extended beyond passenger transport. The Rhinebeck and Connecticut Railroad, started in 1872, carried coal to New England and goods to growing industries, including Baker’s Chocolate in nearby Red Hook. By the 1890s, Rhinebeck had become the greenhouse-grown violet capital of the world — its flowers exported across the country — and Rhinecliff served as the primary shipping center for this fragrant trade. The station platform would have seen crates of violets loaded alongside luggage and freight, the sweet scent mingling with coal smoke and river air.

The prosperity of the railroad era also accelerated the construction of grand estates in the surrounding landscape. Elizabeth Schermerhorn Jones built the formidable Wyndcliffe mansion in 1853 — today a famous ruin — inspiring the phrase ‘keeping up with the Joneses’ as wealthy contemporaries rushed to outdo her on the Hudson’s eastern bluffs. Vice President Levi P. Morton purchased the nearby Ellerslie estate in 1887. Morton and his wife Anna expressed their connection to Rhinecliff most lastingly by constructing and endowing the Morton Memorial Library in 1905, dedicated in 1908 in memory of their daughter Lena — a Colonial Revival gem that continues to anchor the hamlet’s civic life to this day.

Decline and Quiet: The Twentieth Century

The early twentieth century was kinder to Rhinecliff in architecture than in economics. The magnificent 1914 train station — a brick and stone building in the Mission-Spanish Revival style, replacing the original wooden depot — gave the hamlet one of the finest small railroad stations in the Hudson Valley. But the broader forces of the century worked against the hamlet’s vitality. The rise of the automobile and the interstate highway system gradually eroded the railroad’s dominance. Ferry traffic declined as car ownership became universal. The great estate era came to an end: Ellerslie burned, Linwood and Ferncliff were demolished, and only Wilderstein and Wildercliff survived largely intact. Wyndcliffe, abandoned by 1950, began its long collapse into ruin.

The ferry itself finally succumbed in 1957, when the Kingston–Rhinecliff Bridge opened four miles to the north. Governor Harriman cut the ribbon on February 2 of that year, and more than 500 spectators watched the ceremony as the first cars rolled across the new span. The ferry, which had operated with only a brief wartime interruption since 1686, ran its last crossing. The George Clinton — a steel-hulled diesel vessel that had served since 1946 — made its final trip, ending 271 years of river crossings. A chapter that had defined Rhinecliff from its very founding came quietly to a close.

What followed was what local historians have described as a long period of ‘quiescence.’ Without a strong economic base, the hamlet turned inward. IBM’s arrival in Poughkeepsie and Kingston provided employment for some residents. Bard College, Northern Dutchess Hospital, and various nursing homes became significant local employers. The hamlet retained its compact, working-class character: a village green with a war memorial at its center, the post office, the library up the hill, and frame houses cascading down the slopes toward the river. It was quiet and somewhat overlooked — which, as it turned out, helped preserve it.

Historic Recognition and the Modern Era

Rhinecliff’s long slumber contributed directly to its historical integrity. Because so little was built or rebuilt during the mid-twentieth century, much of the hamlet’s nineteenth-century character survived. In 1986, Rhinecliff was recognized in the National Register of Historic Places as a contributor to the Hudson River Historic District — the largest National Historic Landmark in the contiguous United States, covering 34.6 square miles with 1,869 historically significant structures. The hamlet is also designated a Scenic Area of Statewide Significance, a contributor to the DEC Mid-Hudson Historic Shorelands Scenic District, a contributor to DEC Scenic Roads designations, and is included in the Hudson River National Heritage Corridor.

In 2005, the Rhinebeck Town Board created the Rhinecliff Hamlet Advisory Council to facilitate communication between the hamlet and the town government, with goals including protection of the historic hamlet, development of a multi-use greenway connecting hamlet to town, appropriate development of the waterfront, and sensitive residential planning. The council reflects a broader awakening to Rhinecliff’s unique qualities — its combination of railroad access, river views, historic architecture, and small-town character — that has made it attractive to artists, writers, musicians, and commuters seeking an alternative to the more intensively developed Hudson Valley towns.

The hamlet’s notable residents have ranged across centuries and fields. Levi P. Morton, twenty-second Vice President of the United States, lived at Ellerslie. Edith Wharton, the Nobel-shortlisted novelist, was a childhood visitor whose experiences in and around Rhinecliff fed directly into novels including The Age of Innocence and Hudson River Bracketed. In more recent decades, the area has drawn singer-songwriter Natalie Merchant, photographer Annie Leibovitz, and other creative figures drawn by the same landscape that attracted the Livingstons and the Joneses two centuries before.

The Rhinecliff train station — still operating as an Amtrak stop serving some 228,000 passengers annually — remains the hamlet’s most visible connection to its transportation heritage. The 2022 award of a $28.2 million federal grant for station renovation signaled renewed investment in this 110-year-old gateway. Wyndcliffe, meanwhile, entered a new chapter in 2023 when the Rhinebeck Town Board approved an emergency stabilization plan for the long-ruined mansion; active construction work was underway on the site by late 2025. These parallel stories — a station being restored, a ruin being stabilized — capture something essential about Rhinecliff: a place that has survived by not being forgotten, and that carries its layered past into an uncertain but quietly hopeful future.

Today, roughly 380 people call Rhinecliff home — a population barely larger than it was at the hamlet’s railroad-era peak. The river still glimmers below the bluffs. The Catskills still rise across the water to the west. The train still stops. And somewhere in the overgrown woods above Mill Road, a nineteenth-century mansion is being slowly, painstakingly brought back from the edge of collapse — keeping up with Rhinecliff’s long habit of endurance.

References

1. Wikipedia – Rhinecliff, New York

2. About Town Guide – Saga of Rhinecliff

3. Daily Gazette – History of the Rhinecliff Ferry

4. Great American Stations – Rhinecliff, NY (RHI)

5. Wikipedia – Hudson River Historic District

6. HMDB – The Kingston-Rhinecliff Ferry Historical Marker

7. NYSBA – Kingston-Rhinecliff Bridge History

8. Living Places – Rhinecliff Hamlet, Dutchess County, NY

9. Living Places – Rhinebeck Historic MRA (Sixteen Mile District)

10. Wikipedia – Wildercliff

11. World History Encyclopedia – The Wyndclyffe Estate

12. Wikipedia – Rhinecliff Station

13. The Rhinecliff Guide – rhinecliff.info

14. Hudson River Maritime Museum – Kingston-Rhinecliff Ferries

15. The Daily Catch – Rhinecliff Station Federal Grant and Renovation

16. Wikipedia – Rhinebeck (town), New York

Subscribe

Sign up for the latest news and information about Rhinecliff, NY.