Pine Hill Baptist Church was founded 22 August 1893 by a group of community members near the property of William Kay. Charter members, Mrs. William Kay, Mrs. George Kay, Mr. & Mrs. Sol Kay, Mr. & Mrs. J. B. McGee, Mr. & Mrs. J. R. Mitchell Sr., Isaac Newton & Nancy Ann Roberts, David Roberts, David C. & Spicey Jane Westmoreland, George Washington & Minerva C. Westmoreland, & Mrs. Winnie Russell.

After moving several times, Calvin Green Carver(Son-In-Law of G.W. and Minerva Westmoreland) deeded the two acres of land on 23 Aug 1904, where the present church and cemetery are today.

G.W. and Adline had the following childern;
Mary Elizabeth Westmoreland b: 21 OCT 1856 in Louisiana.,
William Westmoreland b: 2 JUN 1858., George Beauregard Westmoreland b: 1862., David Charles Westmoreland b: 8 AUG 1864 in Louisiana.

G.W. and Minerva had the following childern:
John Wesley Westmoreland b: 1 FEB 1867 in Amite County, Mississippi., Zachariah Elijah (Zachary) Westmoreland b: 30 MAR 1869 in Livingston Parish, Louisiana., Florence Carnelia Westmoreland b: 7 JUL 1871 in Livingston Parish, Louisiana., Jane Winfield Westmoreland b: 7 OCT 1873 in Livingston Parish, Louisiana., Emma V. Westmoreland b: 21 APR 1876 in Vernon Parish, Louisiana., and Dora Westmoreland

"George and his second wife, Minerva C. Brabham, were among 16 people who, on Aug. 22, 1893, founded the Pine Hill Bapt. Ch. His first wife was Adaline Julia Brown. He donated the land for the historic Macdonia Bapt. Church, Holden, Livingston Parish, LA prior to moving to Vernon Parish. The husband of his daughter, Mary Elizabeth, was Calvin Green Carver, also a member of both of these churches. The Carvers and Westmorelands moved to Vernon about 1881." Added by Belford Carver