Extraction of moving object is an important step in the system of video surveillance, traffic monitoring, human tracking and other applications. Recent research in computer vision has increasingly focused on building systems for observing humans and understanding their look, activities, and behavior providing advanced interfaces for interacting with humans, and creating sensible models of humans for various purposes. The selected target identification is more helpful for the applications using moving cameras. The interested object that we want to track is obtained from the user. From the initial position using Region of Gaussian the position of the object in all over video were detected. The tracking process is employed based on the Adaptive fuzzy Particle Filter. The texture patterns of the objects were identified based on Complete Local Binary pattern process. The performance for the detection of the objects and the tracking of the objects were measured. The performance metrics employed were much improved compared with the existing methods.