10.5 Search algorithms revisited¶
Searching algorithms (search algorithms) are used to retrieve one or more elements that meet specific criteria within data structures such as arrays, linked lists, trees, or graphs.
Searching algorithms can be divided into the following two categories based on their approach.
- Locating the target element by traversing the data structure, such as traversals of arrays, linked lists, trees, and graphs, etc.
- Using the organizational structure of the data or existing data to achieve efficient element searches, such as binary search, hash search, binary search tree search, etc.
These topics were introduced in previous chapters, so they are not unfamiliar to us. In this section, we will revisit searching algorithms from a more systematic perspective.
10.5.1 Brute-force search¶
A Brute-force search locates the target element by traversing every element of the data structure.
- "Linear search" is suitable for linear data structures such as arrays and linked lists. It starts from one end of the data structure and accesses each element one by one until the target element is found or the other end is reached without finding the target element.
- "Breadth-first search" and "Depth-first search" are two traversal strategies for graphs and trees. Breadth-first search starts from the initial node and searches layer by layer (left to right), accessing nodes from near to far. Depth-first search starts from the initial node, follows a path until the end (top to bottom), then backtracks and tries other paths until the entire data structure is traversed.
The advantage of brute-force search is its simplicity and versatility, no need for data preprocessing or the help of additional data structures.
However, the time complexity of this type of algorithm is \(O(n)\), where \(n\) is the number of elements, so the performance is poor with large data sets.
10.5.2 Adaptive search¶
An Adaptive search uses the unique properties of data (such as order) to optimize the search process, thereby locating the target element more efficiently.
- "Binary search" uses the orderliness of data to achieve efficient searching, only suitable for arrays.
- "Hash search" uses a hash table to establish a key-value mapping between search data and target data, thus implementing the query operation.
- "Tree search" in a specific tree structure (such as a binary search tree), quickly eliminates nodes based on node value comparisons, thus locating the target element.
The advantage of these algorithms is high efficiency, with time complexities reaching \(O(\log n)\) or even \(O(1)\).
However, using these algorithms often requires data preprocessing. For example, binary search requires sorting the array in advance, and hash search and tree search both require the help of additional data structures. Maintaining these structures also requires more overhead in terms of time and space.
Tip
Adaptive search algorithms are often referred to as search algorithms, mainly used for quickly retrieving target elements in specific data structures.
10.5.3 Choosing a search method¶
Given a set of data of size \(n\), we can use a linear search, binary search, tree search, hash search, or other methods to retrieve the target element. The working principles of these methods are shown in Figure 10-11.
Figure 10-11 Various search strategies
The characteristics and operational efficiency of the aforementioned methods are shown in the following table.
Table 10-1 Comparison of search algorithm efficiency
| Linear search | Binary search | Tree search | Hash search | |
|---|---|---|---|---|
| Search element | \(O(n)\) | \(O(\log n)\) | \(O(\log n)\) | \(O(1)\) |
| Insert element | \(O(1)\) | \(O(n)\) | \(O(\log n)\) | \(O(1)\) |
| Delete element | \(O(n)\) | \(O(n)\) | \(O(\log n)\) | \(O(1)\) |
| Extra space | \(O(1)\) | \(O(1)\) | \(O(n)\) | \(O(n)\) |
| Data preprocessing | / | Sorting \(O(n \log n)\) | Building tree \(O(n \log n)\) | Building hash table \(O(n)\) |
| Data orderliness | Unordered | Ordered | Ordered | Unordered |
The choice of search algorithm also depends on the volume of data, search performance requirements, frequency of data queries and updates, etc.
Linear search
- Good versatility, no need for any data preprocessing operations. If we only need to query the data once, then the time for data preprocessing in the other three methods would be longer than the time for a linear search.
- Suitable for small volumes of data, where time complexity has a smaller impact on efficiency.
- Suitable for scenarios with very frequent data updates, because this method does not require any additional maintenance of the data.
Binary search
- Suitable for larger data volumes, with stable performance and a worst-case time complexity of \(O(\log n)\).
- However, the data volume cannot be too large, because storing arrays requires contiguous memory space.
- Not suitable for scenarios with frequent additions and deletions, because maintaining an ordered array incurs a lot of overhead.
Hash search
- Suitable for scenarios where fast query performance is essential, with an average time complexity of \(O(1)\).
- Not suitable for scenarios needing ordered data or range searches, because hash tables cannot maintain data orderliness.
- High dependency on hash functions and hash collision handling strategies, with significant performance degradation risks.
- Not suitable for overly large data volumes, because hash tables need extra space to minimize collisions and provide good query performance.
Tree search
- Suitable for massive data, because tree nodes are stored scattered in memory.
- Suitable for maintaining ordered data or range searches.
- With the continuous addition and deletion of nodes, the binary search tree may become skewed, degrading the time complexity to \(O(n)\).
- If using AVL trees or red-black trees, operations can run stably at \(O(\log n)\) efficiency, but the operation to maintain tree balance adds extra overhead.