To accurately gauge the sentiment of reader comments, a system of variables was created, with each variable embodying pertinent topics being discussed. Using a self-developed methodology that detailed the exact qualifications for each coded variable, content analysis was conducted by reading a comment and coding for presence or absence for all coded variables (using 1 if the content is present and 0 if it is absent). For example, if a comment described the commenter’s dislike for the pipeline and concern about potential degradation of environmental quality, the researcher would code 1s for pipeline, unfavorability, and environment; and 0s for all other categories.
Pre-coding data
POST #
The article/post in order of date in order from oldest to newest within one media source.
COMMENT #
The comment number in the order it appears on comment page. It starts over with every new post.
REPLY#
A reply to a comment in the order it appears on the comment page. Starts over with every new comment.
LINK
URL of post in which comment was made
COMMENT
Copy and paste comment as written
NAME
The full name of the commenter as written on the comment/reply.
DATE
The month, day, and year (01-01-2018) that the comment/reply was published.
CHARACTERS
Number of characters in post as found via word count
LIKES
Number of likes received on the post/reply.
TOWN
The town/city that the individual is from. If not listed on the comment/reply, then the researcher will need to look on the individual’s facebook page.
COUNTY
The county that the individual is from. If not listed on the post/comment, then the researcher will need to look on the individual’s facebook page.
STATE
The geographic state that the individual is from. If not listed on the comment/reply, then the researcher will need to look on the individual’s facebook page.
MVP-SPECIFIC Coded variables
PIPELINE
The comment/reply is related to the pipeline. Includes if “pipeline” is specifically stated or a vague descriptor such as “this” is used in response to an article directly related to the pipeline. The term "project" also is coded as pipeline. Includes anything surrounding the pipeline construction process or structure, clearing/cutting trees, surveying land, compressor stations and people being paid for their land. Includes references to the company: MVP, EQT, EQM, Next Era, ConEdison, Dominion, WGL, Roanoke Gas, or gas companies in general. Anything about tree sitting or protesting in reference to MVP tree sitters (not tree sitting in general) is about the pipeline. Comments such as “let’s fight this” or “fighting the pipeline” implies pipeline and unfavorable content.
The comment is not related to the pipeline when using too general terms or is in response to something that is not regarding the pipeline. FERC will not be considered a descriptor of the pipeline. Comments about natural gas in general are not about the pipeline.
FAVORABLE
The post/comment has favorable content about the pipeline or its impacts, no matter the overarching tone of the post/comment.
UNFAVORABLE
The post/comment has unfavorable content about the pipeline or its impacts, no matter the overarching tone of the post/comment.
DISTINGUISHING BETWEEN FAVORABLE AND UNFAVORABLE CONTENT
Favorable comments can be defined as something positive about the pipeline or that nothing negative will happen because of the pipeline. Unfavorable comments can be defined as something negative about the pipeline or that the pipeline will bring no benefits.
Each comment is the unit of analysis and is judged on a case-by-case basis regardless of past comments. If a person has expressed unfavorable content in past comments, but has a new comment with no unfavorable content, that comment is not deemed unfavorable.
When determining if there is favorable and/or unfavorable content in regards to the Mountain Valley Pipeline (MVP) within a comment or reply, it is first important to consider if the comment/reply is regarding the pipeline. Any post not referencing the pipeline is automatically neither favorable nor unfavorable. However, just because a post is about the pipeline does not mean it is either favorable or unfavorable. If the unfavorability is directed towards the company but not the pipeline - it is not unfavorable.
A statement of fact cannot solely be used as an indication of favorability or unfavorability, for example “the governor has done nothing to stop this,” is not considered an expression of unfavorability, however, if a descriptive word such as “monstrosity” was added to the end of the quoted statement, then this comment would be considered unfavorable. Positive/negative adjectives in reference to the pipeline are enough evidence to determine favorability/unfavorability. Words referring to stealing, robbing, and theft of land are considered to be unfavorable. Hashtags are also be considered, such as #NoMVP or #nopipeline.
A comment/reply can contain content that is favorable and unfavorable to the pipeline. Even if the overall tone of the comment is either favorable or unfavorable, the objective is to distinguish content and not the overall opinion of the commenter.
ENERGY
Energy debate/climate change. Comments about national/global environmental issues including specific energy resources (solar, wind, coal, natural gas, nuclear, petroleum, etc.) and fossil fuels, emissions, carbon, greenhouse gases (GHG), climate change, and climate change activism. Includes reference to “oil and gas industry” only when regarding being pro/con industry as a whole.
Does not include “natural gas pipeline” which is a descriptor of the pipeline itself. Reference to fracking is not included.
When coding this variable, "energy" is considered the input, while the "electricity" is the output and should be coded differently.
ELECTRICITY
Comments coded as electricity are broad arguments about the importance pf "powering America." Comments referring to “energy independence” or providing “power”, “electricity”, “light”, “heat/AC”, or “energy” to homes/business. Includes “we need energy in this country”.
Also includes comments about how “those who oppose the pipeline should have their electricity supply cut off” as this adheres to the general sentiment of this category.
ENVIRONMENT
Ecology/environment related text is present in comment/post. Includes but not limited to: trees or cutting trees, nature, natural resources, virgin/untouched/pristine/beautiful land (or other positive descriptors), oceans, local environmental issues, “ecocidal”, natural disasters, and pipeline leaks, wetlands, sinkholes, and karst terrain.
Does not relate to fresh water quality (rivers, streams, watersheds).
HEALTH
Includes content relating to water quality, such as streams and bodies of water (rivers, streams, watersheds), sources of drinking water, sanitation, public health, and safety that comes from living next to the pipeline both with regards to its explosion or other health issues. Comments that include “toxic” and/or “PCBs” are also included.
LAND RIGHTS
Land rights related text is present in comment/post, including reference to eminent domain, private land, owning land, crossing land, or removing land, government overreach in the taking of land, trespassing on land, easements and conservation easements, and being for the “common good”, public utility, or being in the public’s best interest. References to “stealing/robbing of land” does directly imply land rights.
Wanting the pipeline on your land or telling someone they should want it on their land is not a land rights argument, even if the words crossing/owning/landowner is mentioned. These are hypothetical situations and do not deal with real land right debates.
Asking someone “how they would feel if it was on their land” isn’t land rights.
NIMBY
"Not in my backyard" comments are often associated with aesthetics. NIMBY refers to issues such as changes in property values, increase in price of homeowner's insurance, and change in view sheds or scenery because of the pipeline. This includes the denying of surveying.
Phrases referring to the destruction of the landscape are not considered NIMBY, but rather environment, unless talking about looking at the landscape.
CULTURE
Text related to Appalachian and indigenous peoples’ cultural impacts, historical monuments/ sacred burial sites.
CORPORATE OVERREACH
Text referring to corporate overreach, abuse of power, companies lobbying the government, close relationship between corporations and government, politicians or government officials being “paid off," special treatment/exception from regulations, careless work by the company. Includes money gained by private corporations, lawsuits with/against landowners, benefiting despite not being for the public good, anti-capitalist arguments related to all corporations.
A reference to “stealing of land” does not directly imply corporate overreach unless the source of the stealing is defined as some corporate entity. In this case, both land rights and corporate overreach would be coded 1,1.
ECONOMIC BENEFIT/LOSS
Text related to economic benefits/losses, income, or jobs directly due to development of pipeline, or in reference to jobs created by the natural gas, fossil fuel industry, or green energy in local, regional, or national economy.
Does not include money gained by corporations.
Use of the natural gas in the pipeline within Appalachia vs exportation of gas. Includes external markets and exports, including gas being “shipped away” (overseas or out of the region) and comments referencing an absence of demand or lack of need for natural gas within the area being directly impacted by the pipeline (Appalachia). If someone says “we are not receiving this natural gas” or asks, “will Virginia receive the natural gas” it implies a demand argument.
If someone states, “we need this gas in Appalachia” it would not be coded as demand. Arguments that state “the population is growing so we need more gas” does not count as demand. These arguments are not specific to economic supply and demand.
DEMAND
Variables about tone
Strong profane language and slurs (racial, religious, or sexuality and gender-related).
STRONG PROFANITY
MILD PROFANITY
Mildly profane language present (crap, hell, damn, douche, ass, bastard, sucks). Includes abbreviations of strong profanity such as “WTF” or “BS” or * in replacement of letters such as “a**”. If someone substitutes a non-profane word into a profane phrase- it is not coded as mild profanity.
INSULT
Insulting or offensive descriptive language (adjectives) within comment directed toward a specific or unspecific person/people group, discluding references to the pipeline. Includes xenophobic or racist comments.
HYPOCRISY
Calling out or exposing contradictions from others-- or specifically calling someone a hypocrite.
Anytime a person or group is called out for wanting the energy (pipeline) but not in their backyard.
POLITICS
Political reference made within comment, such as reference to a political party (liberals, libs, dems, republicans, rebubs, libertarian, tea party). Not including local government BUT including those who represent parties as a whole (Trump, Clinton(s), Obama, Pence, Bernie, Elizabeth Warren, Tim Kaine, Bush)