Working with Microsoft® FAST™ Search Server 2010 for SharePoint® by Svenson, Mikael -- Read -- Imperial Library of Trantor

Index

Working with Microsoft® FAST™ Search Server 2010 for SharePoint® A Note Regarding Supplemental Files Foreword Introduction

Who Should Read This Book

Assumptions

Who Should Not Read This Book Organization of This Book

Finding Your Best Starting Point in This Book

Conventions and Features in This Book System Requirements Code Samples

Installing the Code Samples Using the Code Samples

Acknowledgments from All the Authors

Mikael Svenson’s Acknowledgments Marcus Johansson’s Acknowledgments Robert Piddocke’s Acknowledgments

Errata & Book Support We Want to Hear from You Stay in Touch

I. What You Need to Know

1. Introduction to FAST Search Server 2010 for SharePoint

What Is FAST?

Past Present Future Versions

FSIS

CTS, IMS, and FAST Search Designer Search Business Manager and IMS UI Toolkit

FSIA FS4SP

SharePoint Search vs. Search Server Versions, and FS4SP

Features at a Glance

Scalability

Explanation of Features

Item Processing Document Processing/Format Conversion Property Extraction Advanced Query Language (FQL) Duplicate Collapsing Linguistics Refiners

What Should I Choose?

Evaluating Search Needs

Environment

How many users do you have and how often do you expect each one to search? What type of and how much content do you have? How can you make your users take action on the search results? Where are you coming from and where do you want to go? How skilled are your users at searching?

Corpus

How much content do you have to search? Does everything need to be searchable? Are there multiple content sources? How much and in what divisions is the different content being consumed?

Content

What is the quality of the content? Is there rich metadata? What document types are there?

Organization

Does the content have an existing organization (taxonomy, site structure)? How difficult is it to navigate to the most relevant content vs. search?

Decision Flowchart Features Scorecard

Cost Estimator

Conclusion

2. Search Concepts and Terminology

Overview

Relevancy

Recall and Precision Query Expansion Corpus Rank Tuning

Static rank tuning Dynamic rank tuning

Linguistics

Tokenization Keyword rank

Rank Profiles

SharePoint Components

Web Front End Central Administration Search Service Applications Federated Search Object Model Query Web Service Query RSS Feed Query Object Model Web Parts People Search

Content Processing

Content Sources Crawling and Indexing

Indexing Federated Search Document Processor FIXML Indexing Dispatcher

Metadata Index Schema

Query Processing

QR Server Refiners (Faceted Search) Query Language

Token Expressions Property Specifications Boolean Operators

Search Scopes Security Trimming Claims-Based Authentication

Conclusion

3. FS4SP Architecture

Overview Server Roles and Components

FS4SP Architecture

SharePoint Search Service Applications FAST Search Connector (FAST Content SSA) FAST Search Query (FAST Query SSA) Crawl Components and Crawl Databases

Search Rows, Columns, and Clusters

Scenario

FS4SP Index Servers FS4SP Query Result Servers/QR Server

Conclusion

4. Deployment

Overview Hardware Requirements

Storage Considerations

Disk Speed Disk Layout Using a SAN Using NAS Using SSD

FS4SP and Virtualization

Software Requirements Installation Guidelines

Before You Start Software Prerequisites FS4SP Preinstallation Configuration FS4SP Update Installation FS4SP Slipstream Installation Single-Server FS4SP Farm Configuration Deployment Configuration Multi-Server FS4SP Farm Configuration Manual and Automatic Synchronization of Configuration Changes Certificates and Security Creating FAST Content SSAs and FAST Query SSAs Enabling Queries from SharePoint to FS4SP Creating a Search Center Scripted Installation Advanced Filter Pack IFilter

Replacing the Existing SharePoint Search with FS4SP Development Environments

Single-Server Farm Setup Multi-Server Farm Setup Physical Machines Virtual Machines Booting from a VHD

Production Environments

Content Volume Failover and High Availability Query Throughput Freshness Disk Sizing Server Load Bottleneck Planning

Conclusion

5. Operations

Introduction to FS4SP Operations

Administration in SharePoint Administration in Windows PowerShell Other Means of Administration

Using Configuration Files Using Command-Line Tools

Basic Operations

The Node Controller

Starting and Stopping a Single-Server Installation Starting and Stopping a Multi-Server Installation Starting and Stopping Internal Processes Relationship Between the Node Controller and the FS4SP Windows Services Adding and Removing Document Processors A Note on Node Controller Internals

Indexer Administration

Suspending and Resuming Indexing Operations Rebuilding a Corrupt Index

Search Administration Search Click-Through Analysis

Checking the Status of SPRel Reconfiguring SPRel

Link Analysis

Checking the Status of the Web Analyzer Forcing the Web Analyzer to Run Listing the Relevance Data for a Specific Item

Server Topology Management

Modifying the Topology on the FS4SP Farm

Adding One or More Index Columns Without Recrawling

Modifying the Topology on the SharePoint Farm Changing the Location of Data and Log Files

Logging

General-Purpose Logs

Windows Event Logs SharePoint Unified Logging Service (ULS) Internal FS4SP Logs

Functional Logs

Item Processing Logging

Inspect runtime statistics Turn on debug and tracing for the running document processors Inspect crawled properties in the indexing pipeline by using FFDDumper

Crawl Logging Query Logging

Performance Monitoring

Identifying Whether an FS4SP Farm Is an Indexing Bottleneck Identifying Whether the Document Processors Are the Indexing Bottleneck Identifying Whether Your Disk Subsystem Is a Bottleneck

Backup and Recovery

Prerequisites Backup and Restore Configuration

Performing a Configuration Backup Performing a Configuration Restore

Full Backup and Restore

Performing a Full Backup Performing a Full Restore Incremental Backup Speeding Up Backups

Conclusion

II. Creating Search Solutions

6. Search Configuration

Overview of FS4SP Configuration

SharePoint Administration Windows PowerShell Administration Code Administration

Code Example Assumptions

Other Means of Administration

Index Schema Management

The Index Schema Crawled and Managed Properties

SharePoint Windows PowerShell .NET

Full-Text Indexes and Rank Profiles

SharePoint Windows PowerShell .NET

Managed Property Boosts

Windows PowerShell .NET

Static Rank Components

Windows PowerShell

Collection Management

Windows PowerShell .NET

Scope Management

SharePoint Windows PowerShell .NET

Property Extraction Management

Built-in Property Extraction

SharePoint Windows PowerShell .NET

Keyword, Synonym, and Best Bet Management

Keywords

SharePoint Windows PowerShell .NET

Site Promotions and Demotions

SharePoint Windows PowerShell .NET

FQL-Based Promotions

Windows PowerShell

User Context Management

SharePoint Windows PowerShell Adding More Properties to User Contexts

Conclusion

7. Content Processing

Introduction Crawling Source Systems

Crawling Content by Using the SharePoint Built-in Connectors

Content Source Types

SharePoint sites Web Sites File Shares Exchange Public Folders BCS Custom Repository Documentum Lotus Notes

Crawl Rules Management Crawler Impact Rules Management

Crawling Content by Using the FAST Search Specific Connectors

Other FAST Search Specific Functionality for Indexing Content

The Content API The docpush command-line tool

FAST Search Web Crawler

Basic operations Crawl configuration Crawled properties

FAST Search Database Connector

Basic operations Crawl configuration Crawled properties

FAST Search Lotus Notes Connector

Basic operations Crawl configuration Crawled properties

Choosing a Connector

Item Processing

Understanding the Indexing Pipeline Optional Item Processing

The OptionalProcessing.xml Configuration File Built-in Property Extraction

Person names Locations Companies

Custom Property Extraction Custom XML Item Processing Offensive Content Filtering Debugging Item Processing Extended Metadata Extraction of Word and PowerPoint Documents Document Conversion

Integrating an External Item Processing Component

Configuration Developing an External Item Processing Component The Mythical PEWS Framework

Conclusion

8. Querying the Index

Introduction Query Languages

Keyword Query Syntax FQL

Overview Usage

Field/Scope specification Wildcard expressions Reserved words and characters Simple Query Language XRANK

Examples

Search Center and RSS URL Syntax

Search APIs

Querying a QR Server Directly Federated Search Object Model

SharedQueryManager and QueryManager LocationList Location FASTSearchRuntime Executing a Query by Using QueryManager, LocationList, and Location Getting the Correct Total When Using Duplicate Trimming Executing a Query by Using FASTSearchRuntime

Query Object Model

Keyword Query Executing a Query by Using the KeywordQuery Class Executing a Query by Using FQL with the KeywordQuery Class

Query Web Service

Executing a Query by Using the Query Web Service

Query via RSS Choosing Which API to Use

Conclusion

9. Useful Tips and Tricks

Searching Inside Nondefault File Formats

Installing Third-Party IFilters

Extending the Expiration Date of the FS4SP Self-Signed Certificate Replacing the Default FS4SP Certificate with a Windows Server CA Certificate Removing the FAST Search Web Crawler Upgrading from SharePoint Search to FS4SP

Reducing the Downtime When Migrating from SharePoint Search to FS4SP

Improving the Built-in Duplicate Removal Feature Returning All Text for an Indexed Item Executing Wildcard Queries Supported by FQL Getting Relevancy with Wildcards Debugging an External Item Processing Component

Inspecting Crawled Properties by Using the Spy Processor Using the Visual Studio Debugger to Debug a Live External Item Processing Component

Using the Content of an Item in an External Item Processing Component Creating an FQL-Enabled Core Results Web Part Creating a Refinement Parameter by Using Code Improving Query Suggestions

Adding, Removing, and Blocking Query Suggestions Security Trimming Search Suggestions Displaying Actual Results Instead of Suggestions Creating a Custom Search Box and Search Suggestion Web Service

Preventing an Item from Being Indexed

Using List, Library, and Site Permission to Exclude Content Using Crawl Rules Creating Custom Business Rules

Creating a Custom Property Extractor Dictionary Based on a SharePoint List Crawling a Password-Protected Site with the FAST Search Web Crawler Configuring the FAST Search Database Connector to Detect Database Changes Conclusion

10. Search Scenarios

Productivity Search

Introduction to Productivity Search Contoso Productivity Search

Setting Up a Search Center Setting Up Department User Context Creating a Department Refiner Promoting Items for Coworkers by Using an FQL-Enabled Web Part Promoting Items for Coworkers by Using Predefined Scopes Demoting Site Collection Root and Site Home Adding a Products Refiner Using Visual Best Bets to Redirect to a Landing Page Adding Relevant Documents to a Page by Using Enterprise Keywords

Productivity Search Example Wrap-Up

E-Commerce Search

Introduction to E-Commerce Search Adventure Works E-Commerce

Setting Up an External Content Type for Indexing Setting Up a New Content Source Defining Properties, Full-Text Index, and Rank Profile Setting Up a Basic Search Storefront Promoting High-Margin Products

Alternative 1: Extend the Search Core Results Web Part with formula sort Alternative 2: Add the product margin as a static rank component

Setting Up a Price Refiner Conditional on the Product Language Promoting Items Multiple Search Setting Groups

E-Commerce Example Wrap-Up

A. About the Authors Index About the Authors

← Prev
Back
Next →

← Prev
Back
Next →