Eleven
Measuring Technology’s Impact on Relational Life

Assessment of Internet Impact in Daily Life: The Chicken or the Egg?

In Chapter 1, we presented information about how the Internet is associated with our physical and psychological selves, including changes to our sleep cycle, sleep habits, our sense of loneliness and social connectivity, etc. For youth in particular, more time online means less time in bed getting adequate sleep (Ferreira et al., 2017; Nose et al., 2017). We further reviewed articles that associated lack of sleep to a host of psychological problems, including depression, anxiety, substance abuse, and suicidal ideation (Lemola, Perkinson-Gloor, Brand, Dewald-Kaufmann, & Grob, 2015).

But these studies are correlational only. What is less clear is whether the choice to use Internet technologies and other forms of today’s media before or instead of going to sleep is a function of something else that was not measured (also known as the third variable problem) or what the direction of the relationship may be. It is this lack of clarity that may also drive the inconsistencies demonstrated in the research about the impact of technology on our lives. For example, Amichai-Hamburger and Hayat (2011) found using the Internet was associated with a greater sense of connection to others, while other authors have uncovered associations between greater Internet use and loneliness (Stepanikova, Nie, & He, 2010). In determining the extent to which Internet usage is contributing to challenges in couple and family life, part of the conversation has to be whether Internet usage is a symptom of a larger problem or whether Internet usage is in and of itself the primary issue. Healthcare workers including therapists, physicians, nurse practitioners, counselors, social workers, and psychologists are left with the challenges of attempting to determine which came first: the proverbial chicken or the egg.

Perceived etiology of a presenting problem is critical in determining the scope of the problem and course of treatment. Case conceptualizations direct the treatment processes (Ridley, Jeffrey, & Roberson, 2017). The model by which we incorporate information into a case conceptualization is highly complex and is reliant on many things, including (but not limited to): the information obtained in the history/assessment phases of treatment, cultural/contextual considerations, and the theory from which the clinician selects to operate (Ridley et al., 2017). Of course, the clinician frequently has specific ways in which they gather information, which might also lead to a slant in how the information is conceptualized and packaged for treatment. Other factors that affect a clinician’s judgment include how easily they can recall information, how similar the information is to other cases they have seen, their personal beliefs about a given topic (self-of-the-therapist factors), and being overly confident in what they see as the issue. Misspecifications in these levels may lead to misunderstanding about etiology, thus impairing treatment (Falvey, 2001).

Another element that also may influence treatment is the determination as to whether the presenting problem has a biological basis. Evidence of one’s issues being rooted in biology has proven to reduce prison sentences, thus leading to the belief that the evidence of behavior that is tied to one’s biology reduces blame and furthers empathy (Aspinwall, Brown, & Tabery, 2012). When applied to psychological or clinical settings, however, the reverse seems to be true: when clinicians focus primarily on the biology contributing to the problem, they are less likely to feel empathy for the clinical participant (Haslam & Kvaale, 2015). Clinicians retain some level of empathy if they keep in mind the confluence of factors contributing to one’s symptoms, acknowledging the biological contribution and recognizing how that contribution interacts with the family/relational system dynamics, environment, etc. (Lebowitz & Ahn, 2014).

One’s case conceptualization may also be affected by extra therapeutic factors. There are inconsistent findings around whether issues such as profession, demographic variables of the therapist, work setting, or education have an impact (Falvey, 2001). There is, however, good evidence to suggest that the intersectionality of factors such as gender, sexual orientation, religion, and/or racial/ethnic identity of the clinical participants and clinicians affects treatment retention, therapeutic alliance, and clinical outcomes (Blumer, Ansara, & Watson, 2013; Green, Murphy, & Blumer, 2010; Green, Murphy, Blumer, & Palmanteer, 2009; Staczan et al., 2017; Wintersteen, Mensinger, & Diamond, 2005).

Thus far, one study has examined the process of treatment decisions in cases of couple therapy with the Internet as an element in the presenting problem. Hertlein and Piercy (2008) examined the effect of client gender, therapist gender, and the association of the Internet in the assessment and treatment of infidelity cases. In this study, 504 licensed marriage and family therapists (LMFTs) were provided a script of a couple seeking treatment. The scripts were delivered via stratified random sample. One-quarter of the clinicians (all female) received a script of a female cheating on her male partner; a second quarter (also all female) received a script of a male cheating on his female partner. Another quarter (all male) received the script of a female cheating on her male partner. The final quarter (all male) received a script of a male cheating on his female partner. In addition, there were three different clinical scenarios, also distributed evenly to the respondents. One scenario described a case where one partner met and corresponded in a flirtatious manner with another individual and the email exchange was discovered in the trash by their partner. The second scenario was where an individual met someone online and ended up meeting this individual offline. The third scenario was where one person was watching pornography online. When the client who was involved with someone else or using pornography online was a man, the therapist tended to conceptualize the case as having a higher degree of sex “addiction” than when the identified client was a woman, and they were consequently more likely to assign individual treatment. Female therapists were more likely to connect the treatment to larger relational problems than male therapists (Hertlein & Piercy, 2008).

What is most surprising about this finding is despite the couple therapists clearly indicating they believed the problem was a couple problem (stemming from either a deficit in the relationship or other impaired processes), when the problem between the couple had some connection to a computer or the Internet, the participant therapists were more inclined to approve environmental changes (moving the computer to another room) than to employ a change that better reflected their original theory about why the couple was having the problems they were experiencing in the first place (Hertlein & Piercy, 2008).

So why the incongruence? Something almost sinister happens when a computer gets involved. When the Internet is introduced into the clinical setting, it leads clinicians to inappropriate conclusions about how to navigate treatment, potentially ascribing the Internet as the cause of the problem. Part of it may be due to the familiarity that the clinician themselves has with online technology or even their use of such technologies, their own degree of technophobia, and, as Falvey (2001) stated, their personal beliefs—in this case, about technology. For example, couple and family therapists (CFTs) are generally not comfortable with using the Internet as a service-delivery platform (Hertlein, Blumer, & Smith, 2014). In a survey study, CFTs reported they were uncomfortable with the Internet as the sole mechanism for delivery of therapeutic services (Hertlein et al., 2014). While this discomfort was experienced for treating individuals online (42% noted they were very uncomfortable with this modality for individuals in treatment), that proportion increased to 50% of CFTs expressing they were very uncomfortable with couples treatment delivered online and increased again for families (54.4% reported being very uncomfortable with this service delivery) (Hertlein et al., 2014).

CFTs, in particular, cling to the misguided notion that the therapeutic relationship, a key part of treatment, is significantly compromised when therapy is conducted in an online format, despite the empirical evidence to the contrary (Germain, Marchand, Bouchard, Guay, & Drouin, 2010; Glueck, 2013a, b; Hertlein & Earl, in press; Morgan, Patrick, & Magaletta, 2008; Twist & Hertlein, 2016). Why? It makes us, as relational therapists, feel better to think that in-person interactions cannot replicate ones facilitated by a heartless, soulless machine. As many as 61% of therapists surveyed reported that their perception was that the therapeutic alliance was weaker in therapeutic relationships developed online as compared to those developed offline (Hennigan & Goss, 2016). This perception persists despite evidence that most of the time, joining is not impaired by online therapy (Glueck, 2013b), regardless of presenting problem (Jenkins-Guarnieri, Pruitt, Luxton, & Johnson, 2015). In fact, in at least one study the therapeutic relationship was stronger online than offline (Knaevelsrud & Maercker, 2006).

When joining is not necessarily impaired, there may be a level of comfort around face-to-face therapy for clinical participants. In a study with young adults, a significant proportion reported a preference toward face-to-face therapy (Rogers, Griffin, Wykle, & Fitzpatrick, 2009). These results, however, are tempered by the fact that the authors did not use people in treatment. Moreover, individuals were screened out if they were not between the ages of 21 and 30 only. Rather, this sample of convenience included people recruited from Facebook not specifically in therapy and focused on their perception of being in different modalities of therapy. Further, those who indicated they preferred face-to-face might have responded to subsequent questions in a way that would endorse their previously espoused view.

There is some evidence that suggests that romantic relationships develop online more quickly than offline relationships and are characterized by more commitment and greater levels of intimacy because of the increased amount of self-disclosure that occurs in online relationships (Farci, Rossi, Boccia Artieri, & Giglietto, 2017; Hertlein & Blumer, 2013). Self-disclosure on the client’s end is a key part of the therapeutic process and has been demonstrated to lead to powerful changes in personal relationships and life changes (Han & O’Brian, 2014).

The research indicating that effectiveness toward intention to change behavior in conversation is more likely to convince therapists that online therapy may not be ideal (Hammick & Lee, 2014). Finally, younger therapists saw the technology as less of a problem than therapists of a relatively older age in the Hertlein and Piercy (2008) study. While again not causal, it may be that the generational effect and comfort with using technology contribute to one considering the role of technology in treatment as less pathological when compared to clinicians of an older age, as they are generally less comfortable (Schreurs, Quan-Haase, & Martin, 2017). This is in part because comfort is based to some degree on increased digital literacy, which happens through more experience (Murray & Pérez, 2014). In the case of older individuals, if they are reluctant to adopt the technology, they will not have the experience of working toward greater degrees of literacy (Morris, 2007). It may be that therapists are operating from a different community, one described by Christopher Lasch (1979):

Those who dig bomb shelters hope to survive by surrounding themselves with the latest products of modern technology. Communards in the country adhere to the opposite plan: to free themselves on the dependence of technology and thus to outlive its destruction and collapse.

(p. 4)

For all of the aforementioned reasons, it is important to conduct a thorough assessment as to what might be facing a couple or family system when the Internet is involved. It is not as easy as assuming the Internet is the problem, but at the same time, the Internet could be contributing in substantial ways to the difficulties. There are many survey tools designed to assess both the perception of Internet use as well as the extent it may remain problematic in one’s life.

My Problem Is You(Tube)

Problematic Internet use is not a well-defined construct. For example, 5% of women in a Swedish sample self-reported their Internet use as problematic, whereas 13% of men in the sample reported the same. This proportion is consistent with another study by the American Psychiatric Association (APA, 2013), which put the rate of problematic Internet use at between 6% and 14%. Because the estimate of those reporting some level of out-of-control behaviors related to the Internet ranges from 0.3% to near 60% (Parsons, Severino, Grov, Bimbi, & Morgenstern, 2007), it is difficult to determine what proportion of them may actually be experiencing some kind of behavioral “addiction”; potentially 2% of the women and 5% of the men characterized their problematic use as serious (Hertlein & Cravens, 2014). The challenge in identifying problematic behavior is further confused by multiple terms—such as Internet dependence, addiction, and pathological Internet use (Cravens, Hertlein, & Blumer, 2013; Hertlein & Cravens, 2014).

Rather than working with strict definitions only, scholars in the field may focus instead on a cluster of behaviors. Bulut Serin (2011) found that problematic Internet use was tied loosely to gender (for instance, men seemed to have more of a problem than women). Those with higher levels of neuroticism were more likely to use the Internet for entertaining (as opposed to extroverts, who use it for connections with others); in addition, those with higher levels of neuroticism, psychoticism, and who practice more deceptive behaviors have higher levels of out-of-control technology-related behaviors. They may also be the same people who are dissatisfied with life—and in fact, score lower on the Life Satisfaction Scale (Diener, Emmons, Larsen, & Griffin, 1985).

Further, Jones and Hertlein (2012) outlined key differences between various types of problematic Internet behavior across four dimensions. One dimension is the parties that are involved. In Internet infidelity, the involved party is typically an identifiable third person. In so-called “Internet sex addiction,” there may be interaction with others online, but not necessarily an identifiable third person. In “Internet addiction,” there are no involved parties per se—instead, the issue is website surfing and usage. A second dimension is the view of the problem—whether the issue is time spent online (as is the case in “Internet addiction”) or how that time is spent online (content is related to sexual behavior or content is about benign topics). A third dimension is whether physical symptoms are present, as having an “addiction” would imply co-occurrence of withdrawal and tolerance. A final dimension is exploring the extent to which factors such as speed, potency of information, and the importance of being connected to another individual are playing out.

Measuring “Addictive”/Compulsive Internet Use

The rise of the Internet and its insertion into our everyday life have created a near-dependence on the Internet to function in society. Businesses, social groups, and work settings function through a wide variety of software programs and systems with a heavy reliance on passwords, logins, and interactions through email addresses and text notifications. As a result, the discussion around Internet use and the problems associated with it are a mainstream topic in today’s society.

The term “Internet addiction” was actually introduced in 1996 (Goldberg, 1996) and was compared to having the same characteristics as other addictions at the time, including tolerance when playing, symptoms of withdrawal when not using the Internet, and even impairment in one’s academic, workplace, and relationship endeavors (Lortie & Guitton, 2013). The data on problematic usage, however, confirms that the individual’s physiology and psychological state after using the Internet match those using opiates and alcohol (Reed et al., 2017). But, as scholars have used the term “Internet addiction” the term has become more confusing. Jones and Hertlein (2012), for example, argue that the criteria for Young’s (2001) version of Internet addiction contains elements that do not involve the Internet. Young’s criteria led to the development of the Internet Addiction Test, but this inventory focuses on tolerance, withdrawal, ignoring other activities, and using the Internet nearly constantly, all of which are not supported empirically (Cho et al., 2014).

Since the creation of the term, many other inventories have been developed. These include but are not limited to:

Lortie and Guitton (2013) evaluated the criteria included in 14 assessments for problematic Internet behavior. They found seven dimensions present in their review: compulsive use, negative outcomes, withdrawal symptoms, salience, mood regulation, escapism, and social comfort. The “core” of the questionnaires, however, was composed of three of these: compulsive use, negative outcomes, and salience. In addition, the authors were able to find evidence for six of the seven dimensions of having a diagnosis of behavioral addiction, as classified by the APA (2000) in the Diagnostic Statistical Manual of Mental Disorders-IV-Text Revision (DSM-IV-TR), and five of the seven classifying criteria in the International Statistical Classification of Diseases and Related Health Problems-10 (ICD-10) (Lortie & Guitton, 2013). Some scholars have pared down problematic Internet usage into two factors—dependency and distraction (Jia & Jia, 2009). Still others have uncovered more nuanced factors in their operational definitions of problematic Internet use, such as issues in time commitments, emotional/psychological conflict, and difficulty managing one’s mood (Widyanto, Griffiths, & Brunsden, 2011).

In a revision of the GPIU Scale (GPIUS2), three different Internet users were identified in relation to how risky their behavior was in regard to leaving them with a problem with their computer usage (Pontes, Caplan, & Griffiths, 2016). The authors summarized the three groups as such:

Participants in the “low risk” class accounted for almost half of the sample (46.7%) and were characterized as experiencing very few PIU cognitions, behaviors, and/or negative outcomes. Participants with “medium risk” of PIU represented 40.7% of the total sample and tended to use the Internet more often as a way of enhancing their mood, as demonstrated by the markedly high scores on the mood regulation subscale of the GPIUS2. The third and final class comprised 12.6% of the total sample and featured participants showing “high risk” of PIU cognitions, behaviors, and negative outcomes due to Internet use.

(p. 830)

But, of course, this distinction makes no difference to people living with these types of users. In 2018, the World Health Organization tried for a classification of Internet gaming addiction (Revell, 2018).

Measurement Tools

What’s in a Name?

As with many of the behavioral addictions, the determination as to whether a particular set of Internet behaviors is diagnosable is challenging. There are three commonly used diagnostic labels that are applied to out-of-control Internet usage: impulse control disorder, obsessive-compulsive disorder, and addictive disorders, with an “other” or “unspecified” condition (previously not-otherwise-specified in the DSM-IV-TR; APA, 2000; Juhnke & Hagedorn, 2006). Despite their similarities, behavioral addictions do not share all of the same properties as addictions related to substance abuse and differ from impulse control disorders. For example, both behavioral addictions and substance abuse may begin with an

urge or craving state prior to initiating the behavior, as do individuals with substance use disorders prior to substance use. Additionally, these behaviors often decrease anxiety and result in a positive mood state or “high,” similar to substance intoxication. Emotional dysregulation may contribute to cravings in both behavioral and substance use disorders.

(Grant, Potenza, Weinstein, & Gorelick, 2010, p. 234)

Such disorders differ from obsessive-compulsive disorder in that obsessive-compulsive behaviors generally start out as more distressing and/or unacceptable, while addictive behaviors typically become more unpleasant over time as their participation is frequently motivated by avoiding withdrawal or positive reinforcement for continuing the behavior (Grant et al., 2010. Still, the APA (2013) has made little mention of behavioral addictions altogether in the DSM-5. Gaming disorder was included, and Internet gaming disorder was considered, but ultimately not included (Hertlein & Cravens, 2014).

Measuring Online Sexual Behavior

As with the “Internet addiction” inventories, there are also a host of inventories that attempt to measure so-called “sexual addiction” on the Internet, and most notably, the concept of cybersex. One of the areas that is assessed in cybersex is the intensity or severity (Hertlein & Cravens, 2014). One such inventory is the Preoccupied, Ashamed, Treatment, Hurt others, Out of control, Sad (PATHOS) scale (Carnes et al., 2012). Based on inventories that assess severity of alcoholism, PATHOS has six items that focus on how much time is spent pursuing sex online as compared to other activities; sadness, shame, or other negative feelings associated with this activity; one’s awareness of the impact on others of their sexual online behavior; and whether one can govern their online sexual behavior. Other well-known inventories include the Internet Sex Screening Test (ISST) and the Online Sexual Addiction Questionnaire (OSA-Q) (Delmonico, 1997; Putnam, 2013). Both of these latter inventories attempt to assess the manner in which the online sexual activities disrupt day-to-day life. The OSA-Q, in particular, attempts to assess the characteristics associated with addiction in general, including withdrawal, tolerance, and cravings/compulsions to engage in sexual behaviors online.

Another common way for online sexual behavior to be assessed is through a clinical interview (Hertlein & Cravens, 2014). Such an interview not only enables the clinician to ask the client about their online sexual behavior, but also provides an opportunity to ask their partners and family/relational system members about their online sexual behavior (e.g., symptoms and issues they might observe. This may include how the identified patient engages in online interactions with others, the presence of sexual fantasies and how those play out in the couple’s life, any secrecy in one’s activities online, and the presence of any guilt and shame as a consequence of one’s sexual activities online). For American Association of Sexuality Educators, Counselors, and Therapists (AASECT)–certified providers, however, a cautionary note is extended regarding the assessments and line of clinical interviewing one does with regard to exploring online sexual behaviors as it is considered unethical to use assessment tools and/or to frame one’s clinical interviewing in a way that denotes a clinical participant is experiencing a “sex addiction” or an “online sex addiction” (AASECT, 2016). Instead, what is recommended is to work with the clinical participant(s) using a framework like the one proposed by clinicians Douglas Braun-Harvey and Michael A. Vigorito in 2016, which views online sexual behaviors as potentially being out-of-control behaviors in the context of looking at how a person and their partners are experiencing their sexual health and well-being.

The Rebirth of Slick: The Couple and Family Technology Assessment Revised

It is important to work toward understanding the role of the Internet, coping skills, personality and temperament, health, and moderating factors in the contribution to out-of-control technology-related behaviors. At the same time, to merely give an assessment to determine whether one person is out of control with regard to their Internet usage may not be sufficient for family/relational system members and partners who are in pain as a consequence of one’s Internet usage. For example, if a therapist gives an individual inventory and comes to the conclusion that someone is “addicted,” then what? Do the family and partner somehow become empathetic to the partner’s plight? Does it matter what it is called if the behavior is the same? Further, the assessment of Internet “addiction” is not very easy (Pawlikowski, Nader, Burger, Stieger, & Brand, 2014).

Such work has inspired the development of relationally based Internet assessment tools. One example was developed by Campbell and Murray (2015). Known as the Technology and Intimate Relationship Assessment, it poses a series of questions about the respondent’s use of technology, their partner’s use of technology, whether this technology usage is a barrier to communication and intimacy, or whether the use of technology serves as a useful adjunct to the development and maintenance of intimacy in a romantic relationship. Scholars such as Carlisle, Carlisle, Polychronopoulos, Goodman-Scott, and Kirk-Jenkins (2016) consider Internet addiction a process addiction, and propose to measure it within that frame. Loosely defined, a process addiction is where “an individual compulsively engages in a particular activity despite suffering negative consequences after repeated attempts to stop…. Examples include addictions to activities such as gambling, shopping, nonparaphilic hypersexual activities, video games and Internet use” (Northrup, Lapierre, Kirk, & Rae, 2015, p. 342). One of the interesting things, however, from Northrup et al.’s (2015) research was that: (1) their Internet Addiction Test was not related to the gambling addiction test (which the authors surmise may have had something to do with the gambling test), and (2) cellphone usage was not correlated with any of the other technology constructs, which suggested perhaps misspecification in that construct as well.

Hertlein and Blumer (2013) provided an assessment of ecological factors related to the Internet, and we have revised it for this text. Rather than a tool to assess out-of-control technology-related behaviors this tool can evaluate where an individual’s vulnerabilities and strengths lie in the context of Internet usage. Such knowledge will help individuals and families/relational systems identify areas for improvement and change. It is recommended that this revised assessment be used in combination with other assessment tools designed to assess relationship process and structure. This type of assessment would help to establish a closer relationship between teens and parents, while also helping teens cope with their internalizing behaviors that may be contributing to out-of-control technology-related behaviors (Van den Eijnden, Meerkerk, Vermulst, Spijkerman, & Engels, 2008). This type of assessment would also be helpful in working with lesbian, gay, and bisexual (LGB)–identifying individuals and partnerships in making decisions around management of ecological elements like anonymity and accommodation, which manifest often for LGB folks in the form of electronic visibility management (Twist, Belous, Maier, & Bergdall, 2017; Twist, Bergdall, Belous, & Maier, 2017). This tool would also be beneficial to clinicians and their clinical participants in assessing common technology-based issues between couples like the interplay between online infidelity and electronic partner surveillance (Hertlein, Dulley, Cloud, Leon, & Chang, 2017). Honestly, it is our belief that this tool is the most comprehensive and fitting assessment for gaining information and effectively helping relational systems with virtually any technology-based concern with which they present.

The assessment we provide evaluates one’s activities each month across the dimensions described in an earlier section of this book—the ecological elements, as well as the process and the structure of relationships. In addition, we have provided some questions for reflection regarding how one’s family of origin and choice, and their technology usage, has impacted their own views and behaviors around sexuality. This tool can be used for developing understanding for couples and families/relational systems around why technology usage may persist in patterned ways across time and space in relational systems/families. See the Appendix for a full list of the assessment items.

Conclusion

In this chapter, we reviewed a variety of formal assessments and measurements of technology-related issues in the lives of individuals, couples, and families/relational systems. As researchers continue to explore these concepts, we expect this list of potential measures will grow exponentially. It is our hope that assessment will continue to focus not only on the specific Internet-usage behaviors, but also on the provided assessments related to the impact on one’s familial and romantic relationships.

References

American Association of Sexuality Educators, Counselors, and Therapists. (2016). AASECT position on sex addiction. Retrieved from www.aasect.org/print/position-sex-addiction

American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders, DSM-IV-TR. Washington, DC: American Psychiatric Association.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing

Amichai-Hamburger, Y., & Hayat, Z. (2011). The impact of the Internet on the social lives of users: A representative sample from 13 countries. Computers in Human Behavior, 27 (1), 585–589. doi:10.1016/j.chb.2010.10.009

Aspinwall, L. G., Brown, T. R., & Tabery, J. (2012). The double-edged sword: Does biomechanism increase or decrease judges’ sentencing of psychopaths? Science, 337 (6096), 846–849. doi:10.1126/science.1219569

Beranuy Fargues, M., Chamarro Lusar, A., Graner Jordania, C., & Carbonell Sánchez, X. (2009). Validation of two brief scales for Internet addiction and mobile phone problem use. Psicothema, 21 (3), 480.

Blumer, M. L. C., Ansara, Y. G., & Watson, C. M. (2013). Cisgenderism in family therapy: How everyday practices can delegitimize people’s gender self designations. Journal of Family Psychotherapy, 24 (4), 267–285. doi: 10.1080/08975353.2013.849551

Boubeta, A. R. (2015). Pius-A: Problematic Internet use scale in adolescents. Development and psychometric validation. Adicciones, 27 (1), 47–63. doi: 10.20882/adicciones.193

Braun-Harvey, D., & Vigorito, M. (2016). Treating out of control sexual behavior: Rethinking sex addiction. New York, NY: Springer Publishing Company.

Bulut Serin, N. (2011). An examination of predictor variables for problematic Internet use. Turkish Online Journal of Educational Technology—TOJET, 10 (3), 54–62.

Campbell, E. C., & Murray, C. E. (2015). Measuring the impact of technology on couple relationships: The development of the technology and intimate relationship assessment. Journal of Couple & Relationship Therapy, 14 (3), 254–276. doi:10.1080/15332691.2014.953657

Caplan, S. E. (2002). Problematic Internet use and psychosocial well-being: Development of a theory-based cognitive-behavioral measurement instrument. Computers in Human Behavior, 18 (5), 553–575. doi:10.1016/S0747-5632 (02)00004-3

Carlisle, K., Carlisle, R., Polychronopoulos, G., Goodman-Scott, E., & Kirk-Jen kins, A. (2016). Exploring Internet addiction as a process addiction. Journal of Mental Health Counseling, 38 (2), 170–182. doi: 10.17744/mehc.38.2.07

Carnes, P. J., Green, B. J., Merlo, L. J., Polles, A., Carnes, S., & Gold, M. S. (2012). PATHOS a brief screening application for assessing sexual addiction. Journal of Addictive Medicine, 6 (1), 19–34. doi:10.1097/ADM.0b013e3182251a28

Carson, N. J., Gansner, M., & Khang, J. (2018). Assessment of digital media use in the adolescent psychiatric evaluation. Child and Adolescent Psychiatric Clinics of North America, 27 (2), 133–143. doi:10.1016/j.chc.2017.11.003

Ceyhan, E., Ceyhan, A. A., & Gurcan, A. (2007). The validity and reliability of the problematic Internet usage scale. Educational Sciences: Theory and Practice, 7 (1), 411–416.

Cho, H., Kwon, M., Choi, J., Lee, S., Choi, J. S., Choi, S., & Kim, D. (2014). Development of the Internet addiction scale based on the Internet gaming disorder criteria suggested in DSM-5. Addictive Behaviors, 39 (9), 1361–1366. doi:10.1016/j.addbeh.2014.01.020

Cravens, J. D., Hertlein, K. M., & Blumer, M. L. C. (2013). Online mediums: Assessing and treating Internet issues in relationships. Family Therapy Magazine, 18–23.

Davis, R. A., Flett, G. L., & Besser, A. (2002). Validation of a new scale for measuring problematic Internet use: Implications for pre-employment screening. Cyberpsychology & Behavior: The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society, 5 (4), 331–345. doi:10.1089/10949310276 0275581

Delmonico, D. L. (1997). Internet sex screening test. Arizona: International Institute for Trauma and Addiction Professionals. Retrieved from: www.sexhelp.com/component/content/article/80-am-i-a-sex-addict/130-Internetsex-screening-iss

Demetrovics, Z., Király, O., Koronczai, B., Griffiths, M. D., Nagygyörgy, K., Elekes, Z.,… Urbán, R. (2016). Psychometric properties of the Problematic Internet Use Questionnaire Short-Form (PIUQ-SF-6) in a nationally representative sample of adolescents. PLOS ONE, 11 (8), e0159409. doi:10.1371/jour nal.pone.0159409

Demetrovics, Z., Szeredi, B., & Rózsa, S. (2008). The three-factor model of Internet addiction: The development of the problematic Internet use questionnaire. Behavior Research Methods, 40 (2), 563–574. doi:10.3758/BRM.40.2.563

Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49 (1), 71–75. doi:10.1207/s15327752jpa4901_13

Ekizoglu, N., & Ozcinar, Z. (2011). A study of developing an anxiety scale towards the Internet. Procedia—Social and Behavioral Sciences, 15, 3902–3911. doi:10.1016/j.sbspro.2011.04.392

Falvey, J. E. (2001). Clinical judgment in case conceptualization and treatment planning across mental health disciplines. Journal of Counseling & Development, 79 (3), 292–303. doi:10.1002/j.1556-6676.2001.tb01974.x

Farci, M., Rossi, L., Boccia Artieri, G., & Giglietto, F. (2017). Networked intimacy. Intimacy and friendship among Italian Facebook users. Information, Communication & Society, 20 (5), 784–801. doi:10.1080/1369118X.2016.1203970

Ferreira, C., Ferreira, H., Vieira, M. J., Costeira, M., Branco, L., Dias, Â., & Macedo, L. (2017). Epidemiology of Internet use by an adolescent population and its relation with sleep habits. Acta Médica Portuguesa, 30 (7), 524–533. doi:10.20344/amp.8205

Germain, V., Marchand, A., Bouchard, S., Guay, S., & Drouin, M. (2010). Assessment of the therapeutic alliance in face-to-face or videoconference treatment for posttraumatic stress disorder. Cyberpsychology, Behavior, and Social Networking, 13 (1), 29–35. doi:10.1089/cyber.2009.0139

Glueck, D. (2013a). Business aspects of telemental health in private practice. In K. M. L. Turvey (Ed.), Telemental health (pp. 111–133). Oxford: Elsevier.

Glueck, D. (2013b). Establishing therapeutic rapport in telemental health. In K. Myers & C. L. Turvey (Eds.), Telemental health: Clinical, technical, and administrative foundations for evidence-based practice. Elsevier insights (pp. 29–46). Amsterdam, Netherlands: Elsevier. doi:10.1016/B978-0-12-416048-4.00003-8

Goldberg, I. (1996). Internet addiction disorder. Retrieved July 8, 2018, from www.urz.uni-heidelberg.de/Netzdienste/anleitung/wwwtips/8/addict.html

Grant, J. E., Potenza, M. N., Weinstein, A., & Gorelick, D. A. (2010). Introduction to behavioral addictions. The American Journal of Drug and Alcohol Abuse, 36 (5), 233–241. doi:10.3109/00952990.2010.491884

Green, M. S., Murphy, M. J., & Blumer, M. L. C. (2010). Marriage and family therapists’ comfort working with lesbian and gay clients: The influence of religious practices and support for lesbian and gay human rights. Journal of Homosexuality, 57 (10), 1–17.

Green, M. S., Murphy, M. J., Blumer, M. L. C., & Palmanteer, D. (2009). Marriage and family therapists’ comfort level working with gay and lesbian individuals, couples, and families. The American Journal of Family Therapy, 37, 159–168.

Hammick, J. K., & Lee, M. J. (2014). Do shy people feel less communication apprehension online? The effects of virtual reality on the relationship between personality characteristics and communication outcomes. Computers in Human Behavior, 33, 302–310. doi:10.1016/j.chb.2013.01.046

Han, Y., & O’Brien, K. M. (2014). Critical secret disclosure in psychotherapy with Korean clients. The Counseling Psychologist, 42 (4), 524–551. doi:10.1177/0011000014524600

Haslam, N., & Kvaale, E. P. (2015). Biogenetic explanations of mental disorder: The mixed-blessings model. Current Directions in Psychological Science, 24 (5), 399–404. doi:10.1177/0963721415588082

Hennigan, J., & Goss, S. P. (2016). UK secondary school therapists’ online communication with their clients and future intentions. Counselling and Psychotherapy Research, 16 (3), 149–160. doi:10.1002/capr.12082

Hertlein, K. M., & Blumer, M. L. C. (2013). The couple and family technology framework: Intimate relationships in a digital age. New York, NY: Routledge.

Hertlein, K. M., Blumer, M. L. C., & Smith, J. M. (2014). Marriage and family therapists’ use and comfort with online communication with clients. Contemporary Family Therapy, 36 (1), 58–69. doi:10.1007/s10591-013-9284-0

Hertlein, K. M., & Cravens, J. D. (2014). Assessment and treatment of Internet sexuality issues. Current Sexual Health Reports, 6 (1), 56–63. doi:10.1007/s11930-013-0011-5

Hertlein, K. M., Dulley, C., Chang, J., Cloud, R., & Leon, D. (2017). Does absence of evidence mean evidence of absence? Managing the issue of partner surveillance in infidelity treatment. Sexual and Relationship Therapy, 32(3–4), 323–333. doi: 10.1080/14681994.2017.1397952

Hertlein, K. M., & Earl, R. (in press). Internet-delivered therapy in couple and family work.

Hertlein, K. M., & Piercy, F. P. (2008). Therapists’ assessment and treatment of Internet infidelity cases. Journal of Marital and Family Therapy, 34 (4), 481–497. doi:10.1111/j.1752-0606.2008.00090.x

Hou, J., Huang, Z., Li, H., Liu, M., Zhang, W., Ma, N.,… Zhang, X. (2014). Is the excessive use of microblogs an Internet addiction? Developing a scale for assessing the excessive use of microblogs in Chinese college students. PLoS ONE, 9 (11), e110960. doi:10.1371/journal.pone.01109600

Jenkins-Guarnieri, M. A., Pruitt, L. D., Luxton, D., D., & Johnson, K. (2015). Patient perceptions of telemental health: Systematic review of direct comparisons to in-person psychotherapeutic treatments. Telemed e-Health, 21 (8), 652–660.

Jia, H. H., & Jia, R. (2009). Factorial validity of problematic Internet use scales. Computers in Human Behavior, 25 (6), 1335–1342. doi:10.1016/j.chb.2009.06.004

Jones, K. E., & Hertlein, K. M. (2012). Four key dimensions for distinguishing Internet infidelity from Internet and sex addiction: Concepts and clinical application. The American Journal of Family Therapy, 40 (2), 115–125. doi:10.1080/01926187.2011.600677

Juhnke, G. A., & Hagedorn, B. (2006). Counseling addicted families: An integrated assessment and treatment model. New York, NY: Routledge

Khazaal, Y., Chatton, A., Atwi, K., Zullino, D., Khan, R., & Billieux, J. (2011). Arabic validation of the Compulsive Internet Use Scale (CIUS). Substance Abuse Treatment, Prevention, and Policy, 6 (1), 32. doi:10.1186/1747-597x-6-32

Kim, D., Lee, Y., Lee, J., Nam, J. K., & Chung, Y. (2014). Development of Korean Smartphone Addiction Proneness Scale for youth. PLoS ONE, 9 (5), e97920. doi:10.1371/journal.pone.0097920

Knaevelsrud, C., & Maercker, A. (2006). Does the quality of the working alliance predict treatment outcome in online psychotherapy for traumatized patients? Journal of Medical Internet Research, 8 (4), 31. doi:10.2196/jmir.8.4.e31

Lasch, C. (1979). The culture of narcissism: American life in an age of diminishing expectations. New York, NY: W. W. Norton & Company.

Lebowitz, M. S., & Ahn, W. (2014). Effects of biological explanations for mental disorders on clinicians’ empathy. Proceedings of the National Academy of Sciences of the United States of America, 111 (50), 17786–17790. doi:10.1073/pnas.1414058111

Lemola, S., Perkinson-Gloor, N., Brand, S., Dewald-Kaufmann, J. F., & Grob, A. (2015). Adolescents’ electronic media use at night, sleep disturbance, and depressive symptoms in the smartphone age. Journal of Youth and Adolescence, 44 (2), 405–418. doi:10.1007/s10964-014-0176-x

Lin, Y., Chang, L., Lee, Y., Tseng, H., Kuo, T. B., & Chen, S. (2014). Development and validation of the Smartphone Addiction Inventory (SPAI). PLoS ONE, 9 (6), e98312. doi:10.1371/journal.pone.0098312

Lortie, C. L., & Guitton, M. J. (2013). Internet addiction assessment tools: Dimensional structure and methodological status. Addiction, 108 (7), 1207–1216. doi:10.1111/add.12202

Mak, K., Lai, C., Ko, C., Chou, C., Kim, D., Watanabe, H., & Ho, R. (2014). Psychometric properties of the revised Chen Internet Addiction Scale (CIAS-R) in Chinese adolescents. Journal of Abnormal Child Psychology, 42 (7), 1237–1245. doi:10.1007/s10802-014-9851-3

Meerkerk, G., Van Den Eijnden, R. J. J. M., Vermulst, A. A., & Garretsen, H. F. L. (2009). The compulsive Internet use scale (CIUS): Some psychometric properties. Cyberpsychology & Behavior: The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society, 12 (1), 1–6. doi:10.1089/cpb.2008.0181

Monacis, L., Sinatra, M., Griffiths, M. D., & De Palo, V. (2018). Assessment of the Italian Version of the Internet Disorder Scale (IDS-15). International Journal of Mental Health and Addiction, 16 (3), 680–691. doi:10.1007/s11469-017-9823-2

Morgan, R. D., Patrick, A. R., & Magaletta, P. R. (2008). Does the use of tele-mental health alter the treatment experience? Inmates perceptions of telemental health versus face-to-face treatment modalities. Journal of Consulting and Clinical Psychology, 76 (1), 158–162. doi:10.1037/0022-006X.76.1.158

Morris, A. (2007). E-literacy and the grey digital divide: A review with recommendations. Journal of Information Literacy, 1 (3). doi:10.11645/1.3.14

Murray, M., & Pérez, J. (2014). Unraveling the digital literacy paradox: How higher education fails at the fourth literacy. Issues in Informing Science and Information Technology, 11, 085–100. doi:10.28945/1982

Nichols, L. A., & Nicki, R. (2004). Development of a psychometrically sound Internet addiction scale: A preliminary step. Psychology of Addictive Behaviors, 18 (4), 381–384. doi:10.1037/0893-164x.18.4.381

Northrup, J., Lapierre, C., Kirk, J., & Rae, C. (2015). The Internet process addiction test: Screening for addictions to processes facilitated by the Internet. Behavioral Sciences, 5 (3), 341–352. doi:10.3390/bs5030341

Nose, Y., Fujinaga, R., Suzuki, M., Hayashi, I., Moritani, T., Kotani, K., & Nagai, N. (2017). Association of evening smartphone use with cardiac autonomic nervous activity after awakening in adolescents living in high school dormitories. Child’s Nervous System, 33 (4), 653–658. doi:10.1007/s00381-017-3388-z

Parsons, J. T., Severino, J. P., Grov, C., Bimbi, D. S., & Morgenstern, J. (2007). Internet use among gay and bisexual men with compulsive sexual behavior. Sexual Addiction & Compulsivity, 14 (3), 239–256. doi:10.1080/10720160701480659

Pawlikowski, M., Nader, I. W., Burger, C., Stieger, S., & Brand, M. (2014). Pathological Internet use: It is a multidimensional and not a unidimensional construct. Addiction Research & Theory, 22 (2), 166–175. doi:10.3109/16066359. 2013.793313

Pontes, H. M., Caplan, S. E., & Griffiths, M. D. (2016). Psychometric validation of the Generalized Problematic Internet Use Scale 2 in a Portuguese sample. Computers in Human Behavior, 63, 823–833. doi:10.1016/j.chb.2016.06.015

Putnam, D. E. (2013). Online sexual addiction questionnaire (OSA-Q). Retrieved from www.onlinesexaddict.com/osaq.html

Reed, P., Romano, M., Re, F., Roaro, A., Osborne, L., Viganò, C., & Truzoli, R. (2017). Differential physiological changes following Internet exposure in higher and lower problematic Internet users. PLoS ONE, 12 (5), e0178480.

Revell, T. (2018). Gaming really can be bad for you. New Scientist, 237 (3159), 10. doi:10.1016/s0262-4079(18)30012-5

Ridley, C. R., Jeffrey, C. E., & Roberson, R. B. (2017). Case mis-conceptualization in psychological treatment: An enduring clinical problem. Journal of Clinical Psychology, 73 (4), 359–375. doi:10.1002/jclp.22354

Rogers, V. L., Griffin, M. Q., Wykle, M. L., & Fitzpatrick, J. J. (2009). Internet versus face-to-face therapy: Emotional self-disclosure issues for young adults. Issues in Mental Health Nursing, 30 (10), 596–602. doi:10.1080/01612840903003520

Schreurs, K., Quan-Haase, A., & Martin, K. (2017). Problematizing the digital literacy paradox in the context of older adults’ ICT use: Aging, media discourse, and self-determination. Canadian Journal of Communication, 42 (2). doi:10.22230/cjc.2017v42n2a3130

Staczan, P., Schmuecker, R., Koehler, M., Berglar, J., Crameri, A., von Wyl, A.,…

Tschuschke, V. (2017). Effects of sex and gender in ten types of psychotherapy. Psychotherapy Research, 27 (1), 74–88. doi:10.1080/10503307.2015.1072285

Stepanikova, I., Nie, N. H., & He, X. (2010). Time on the Internet at home, loneliness, and life satisfaction: Evidence from panel time-diary data. Computers in Human Behavior, 26 (3), 329–338. doi:10.1016/j.chb.2009.11.002

Twist, M. L. C., & Hertlein, K. M. (2016). Ethical couple and family e-therapy. In M. J. Murphy & L. Hecker (Eds.), Ethics and professional issues in couple and family therapy (2nd ed., pp. 261–282). New York, NY: Routledge.

Twist, M. L. C., Belous, C. K., Maier, C. A., & Bergdall, M. K. (2017). Considering technology-based ecological elements in lesbian, gay, and bisexual partnered relationships. Sexual and Relationship Therapy, 32 (3/4), 291–308.

Twist, M. L. C., Bergdall, M. K., Belous, C. K., & Maier, C. A. (2017). Electronic visibility management of lesbian, gay, and bisexual identities and relationships. Journal of Couple and Relationship Therapy: Innovations in Clinical Educational Interventions, 16 (4), 271–285.

Van den Eijnden, R. J., Meerkerk, G., Vermulst, A. A., Spijkerman, R., & Engels, R. C. (2008). Online communication, compulsive Internet use, and psychosocial well-being among adolescents: A longitudinal study. Developmental Psychology, 44 (3), 655–665. doi:10.1037/0012–1649.44.3.655

Widyanto, L., Griffiths, M. D., & Brunsden, V. (2011). A psychometric comparison of the Internet addiction test, the Internet-related problem scale, and self-diagnosis. Cyberpsychology, Behavior and Social Networking, 14 (3), 141–149. doi:10.1089/cyber.2010.0151

Wintersteen, M. B., Mensinger, J. L., & Diamond, G. S. (2005). Do gender and racial differences between patient and therapist affect therapeutic alliance and treatment retention in adolescents? Professional Psychology: Research and Practice, 36 (4), 400–408.

Yong, R. K., Inoue, A., & Kawakami, N. (2017). The validity and psychometric properties of the Japanese version of the Compulsive Internet Use Scale (CIUS). BMC Psychiatry, 17 (1). doi:10.1186/s12888-017-1364-5

Young, K. S. (2001). Caught in the net: How to recognize the signs of Internet addiction—and a winning strategy for recovery. New York, NY: John Wiley & Sons, Ltd.

Zhang, J., & Xin, T. (2013). Measurement of Internet addiction: An item response analysis approach. Cyberpsychology, Behavior, and Social Networking, 16 (6), 464–468. doi:10.1089/cyber.2012.0525