Documentum Federation and troubleshooting

Federation is a distributed configuration where there is one governing repository and member repositories. The advantage of federation is global users, global groups and global ACL's created on governing repository will be replicated on to member repositories. User will have access to all repositories though he was created only in governing repository.

General issues seen in Federation:

User or group or ACL does not get created on a member repository.

Reason: Federation update job failed to execute on member repositories.

Make sure federation object on member docbase is not checked out.

select r_object_id, r_lock_owner, r_lock_date, r_lock_machine from dm_federation

Whenever federation job runs on member repository it checks out federation object and copies over newly created/changed user, group, ACL and check back in federation object. Sometime due to sudden outage or if environment was restarted in the middle when federation job was running then federation object remains checked out due to which next time when federation update job runs it fails to get hold on federation objects as it is already checked out.

To resolve this issue touch the user or group in governing repository.

Touching means incase of users to make some modifications like "Workflow disabled" and save the changes so there is a r_modify_date current date stamp on the user object. Similarly, on groups add yourself and delete yourself from the groups that failed which does nothing to the group but creates a current r_modify_date.

Then run the Fed update job manually that will pick up the changes.

The log_entry attribute of dm_federation is what is used to pick up the last run. This is the same for governing repository or all the member repositories. You cannot modify that attribute via API, so go to "dmadmin" home cabinet, then show all object and versions, then choose show hidden objects in preferences. You can then do properties of the "governing repository" object and modify the "User_comments" attributes that corresponds to log_entry.

The above is the only way to change the start time of next run of Fed Update.

------------------------------------------------------------------------------------------

MANUAL STEPS FOR FED UPDATE IF IT FAILS:

Make sure all federation jobs are inactive and the dm_federation object is not locked on both repository using the command given below.

select r_object_id, r_lock_owner, r_lock_date, r_lock_machine from dm_federation

Logon to Content Server and do the following from command prompt.

set ClassPath=%ClassPath%;

This operation creates the ldif file in "D:\Documentum\share\temp\ldif" directory and trace file in "D:\Documentum\share\temp\ldif\< Governing Repository >" directory. You can modify the from and to dates to make short multiple runs If the data is too much. For date format, 12-6 or 12-06 is OK. For time format, always use 01:38 instead of 1:38.

PLEASE PICKUP THE TO_DATE FROM THE LAST SUCCESSFULL RUN OF FED UPDATE LOG AND USE IS AS THE FROM_DATE IN THE MANUAL RUN.

java dm_ldif_export -docbase_name <Governing Repository> -user_name dmadmin -password <password> -domain_name <domain> -trace_level 10 -from_date "2010-09-15 00.00.00" -to_date "2010-9-22 00.00.00"

Copy the ldif file in "D:\Documentum\share\temp\ldif" location to "D:\Documentum\share\temp\ldif\<repository_name>" location for each member docbase on Content Server.

Get the r_object_id of dm_federation object by running the following commands on the governing repository

  select * from dm_federation (or) select r_object_id from dm_federation

Run the following API commands using the r_object_id from previous step. You will need to update keywords[0] through keywords[4] to update member docbase

API:>fetch,c,5e01a5cc80004101

API:>dump,c,5e01a5cc80004101 - Verify what is in keywords[0]. It would FAILED or status of last run

API:>set,c,5e01a5cc80004101,keywords[0]

SET:><name of the ldif file without the extension> - example: "ldif_2008-01-24 08.00.00"

API:>save,c,5e01a5cc80004101

API:>fetch,c,5e01a5cc80004101

API:>dump,c,5e01a5cc80004101 - to verify that the keywords[0] got updated.

Run the below command in Content Server in the other command window where you ran the ldif_export method. If you closed that window, make sure you run the set ClassPath command before running the below. This operation will copy the ldif file to each member docbase.

java dm_ldif_copy -docbase_name < Governing Repository > -user_name dmadmin -password <password> -trace_level 10

The LDIF file will be in the member docbases, but not retrieved to filesystem yet. The ldif import method will retrieve the file and copy it into the file system.

Run the below command from the content server for each member docbase. This will retrieve the ldif file from repositories and stage it in the"d:\Documentum\share\temp\ldif" location, import the users, groups and ACLs identified in the ldif file. Depending on the size of the ldif file and the size of groups worked on, it might take time.Typically, if the changes are not huge, it completes in less than 5 minutes.

set ClassPath=%ClassPath%;D:\Documentum\product\5.3\bin

Execute below command for the member repository where federation job failed.

java dm_ldif_import -docbase_name <Member Docbase> -user_name dmadmin -password <password> -trace_level 10

Run the below command now from Content Server in the same command window where you ran

the other ldif methods. If not set ClassPath before executing the command below.

EVEN IF THE IMPORT HAD WARNINGS, YOU HAVE TO RUN THIS COMMAND AS IT COMPLETES THE FULL CYCLE.

java dm_ldif_status -docbase_name <Governing Repository> -user_name dmadmin -password <password> -trace_level 10

Set r_member_refresh attribute of fed object to the end date of ldif_export method. Even if you set it here, the from_date for ldif_export defaults to last run of Fed update irrespective of whether it was success or failure. So, this step does not really add any value. r_member_refresh[0]-[4] needs to be updated.

select r_object_id from dm_federation

API:>fetch,c,5e005ffd8016b628

API:>dump,c,5e005ffd8016b628 - Verify what is in r_member_refresh[0]. It would usually have the date of last run of Fed Update even if it was a failure.

API:>set,c,5e005ffd8016b628,r_member_refresh[0]

SET:><to_date of last manual run of ldif_export> - Format is like "1/25/2008 13:45:00"

API:>save,c,5e005ffd8016b628

API:>fetch,c,5e005ffd8016b628

API:>dump,c,5e005ffd8016b628

 -----------------------------------------------------------------------

Documentum Interview Questions

Unix related

How do you search for a word in a document in UNIX?

grep.

What is the difference between find and grep?

 Find searches files where as grep searches for words in a file.

How do you perform silent install in Unix?

Using response file.

How do you schedule jobs in UNIX?

Crontab is used.

What are different types of shell scripts in UNIX?

Bourne shell and the C shell.

Documentum related questions

How to set up HA(High Availability) content server?

What are different components of Documentum?

Content Server,Doc Broker,Repository,Queue Manager -- on Content Server

Index Server used for Indexing documents.

Rendition Server used for rendering of documents.

How to perform quick check of Documentum components like queue manager,index server, renditon server?

Import a document 

Promote it -- If it got promoted to next state -- Queue Manager is working.

Create a renditon -- If rendition got created  -- Rendition server is working fine.

Search for that document -- If document is returned in search results -- Index server is working fine.

How to migrate ACL's from one repository to another?

Dump and Load.

While migrating what are the necessary things to check for?

What is virtual user?

Virtual User (VU) is an automated testing tool that allows a computer to emulate a human user, performing actions such as clicking the mouse and typing keys.

What is the folder hierarchy in which customization are implemented?

custom
webtop
webcomponent
wdk

Developer questions:

What are data handlers?
What webtop components did you customize?
What are business objects? have you written any?
Lifecycle of a component?
What's the difference between a container and a component?
Do you need a container to write a component?
Write a DQL to update ACL on a object?
What are object level permissions?
What is app.xml and web.xml and what's the difference?
How do you write a component?

DQL to find queued items

selectg.r_object_id,g.object_name,q.date_sent,g.r_object_type,g.r_content_size,q.sent_by from gar_global g, dm_queue  q where q.name='dm_mediaserver' and g.r_object_id=q.item_id order by q.date_sent

================================================
API to dequeue items

dequeue,c,<stamp>

================================================

Status of a workflow can also be monitored using certain DQL statements.

The following are a few DQL queries that can be used for the monitoring purposes:

select  wf.object_name as workflow_name, wf.r_creator_name as creator, qi.task_name as task_name, qi.task_state as task_state, wi.r_performer_name as performer, wi.r_creation_date as creation_date, wi.r_due_date as due_date, wi.r_priority as priority, wi.r_sign_off_req as sign_off_req from dm_workflow wf, dmi_queue_item qi, dmi_workitem wi where qi.router_id = wi.r_workflow_id and wi.r_workflow_id=wf.r_object_id

This query will query the workflow and its activity with the status, performer, dates, priority, and sign off request.

workflow_name: is the name of the workflow that in currently active

creator: is the user who starts the workflow (usually the user that is provided to run the workflow job

task_name: current task/activity that the workflow is running

performer: user who is assigned to perform the task

task_state: status of the task. (dormant/acquire/finish)

creation_date: start date of the activity

due_date: exist if the activity has a timer required to be finished with in certain time

priority: priority of the activity

sign_off_req: is 1 if the activity is needed to be sign-off before finishing the task

-------------------------------------------------------------------------------------

select wf.object_name as workflow_name, pkgs.r_package_name as package_name, pkgr.r_component_chron_id as component_id, pkgr.r_component_name as component_name from dm_workflow wf, dmi_package_rp pkgr, dmi_package_sp pkgs where wf.r_object_id = pkgs.r_workflow_id and pkgr.r_object_id=pkgs.r_object_id

This query will query the package that is attached to the workflow and its attached objects.
 
workflow_name: is the name of the workflow that in currently active

package_name: package that is used within the workflow

component_id: an object id of an object that is in the package

component_name: an object name of an object that is in the package

=============================================

Count Objects by Month or Year 

select DATETOSTRING(r_creation_date, 'yy/mm') as period, count(*)
from dm_document group by DATETOSTRING(r_creation_date, 'yy/mm')

============================================

Get Value Assistance for an Attribute

select valid_values as type_value from dm_value_list where r_object_id in
(select default_id from dm_cond_id_expr where r_object_id in
(select cond_value_assist from dmi_dd_attr_info where type_name='employee' and attr_name='first_name'))
order by valid_values

=======================================================

It is the query that the agent exec process uses to work out what jobs to run next.

SELECT ALL r_object_id, object_name, a_next_invocation FROM dm_job WHERE ( (run_now = 1) OR ((is_inactive = 0) AND ( ( a_next_invocation <= DATE('now') AND a_next_invocation IS NOT NULLDATE ) OR ( a_next_continuation <= DATE('now') AND a_next_continuation IS NOT NULLDATE ) ) AND ((expiration_date > DATE('now')) OR (expiration_date IS NULLDATE)) AND ((max_iterations = 0) OR (a_iterations < max_iterations))) ) AND (i_is_reference = 0 OR i_is_reference is NULL) AND (i_is_replica = 0 OR i_is_replica is NULL) ORDER BY a_next_invocation, r_object_id

============================================

 Index Queue Count

select count(*) from dmi_queue_item a, dm_sysobject (all) b where b.r_object_id = a.item_id and b.object_name = a.item_name and (a.task_state = 'acquired' or a.task_state is NULL or a.task_state = '') and a.name = 'dm_fulltext_index_user'

============================================

To add a format

create dm_format object set name='jpeg_ws', set description='Custom alticor Thumbnails', set mac_creator='????', set mac_type='JPEG', set dos_extension='jpg', set mime_type='image/jpeg', set default_storage='280175d680000114'

=============================================

To See active sessions

execute show_sessions

execute list_sessions

execute count_sessions

==========================

Display objects with Cabinet

select d.object_name as "Document", c.object_name as "Repository",f.object_name from dm_cabinet c,dm_folder f, dm_document d where f.i_cabinet_id=c.r_object_id and any d.i_folder_id=f.r_object_id

================================

To find file system path of an object’s content file

select file_system_path from dm_location where object_name in (select root from dm_filestore where name in(select a_storage_type from dm_document where r_object_id = ‘object_id’))

========================================

To find the default file store of a type

select name from dm_store where r_object_id in(select default_storage from dmi_type_info where r_type_id in(select r_object_id from dm_type where name = ‘my_document’))

========================================

To find users and  groups they belong to

select u.r_object_id,u.user_name,u.user_state,u.r_modify_date,g.group_name from dm_user u, dm_group g where u.user_name not like 'ldap%' and u.user_name not like 'dm_%' and any g.users_names = u.user_name and u.user_source='LDAP' order by u.user_name,g.group_name

============================================

DQL to get folder path


SELECT s.object_name, f.r_folder_path FROM dm_sysobject s, dm_folder f WHERE s.i_folder_id = f.r_object_id AND f.r_folder_path != ‘’ AND additional conditions ENABLE (ROW_BASED)


=======================================================

Dump and Load Syntax

The following set of commands will dump all of your relevant information out of your docbase. It will extract all of your content objects (and their content), as well as your formats and users:

create,c,dm_dump_record
set,c,l,file_name
c:\temp\adump.new
set,c,l,include_content
T


append,c,l,type
dm_sysobject
append,c,l,predicate
1=1

append,c,l,type
dm_format
append,c,l,predicate
1=1

append,c,l,type
dm_user
append,c,l,predicate
1=1

save,c,l
getmessage,c 
 

This script dumpts all dm_sysobject objects, dm_format objects, and dm_user objects from you docbase. Also the content of these objects will be included. You will notice that for each object type we append a predicate of “1=1″. Since the predicate is required, this is a way of tricking Documentum into exporting all objects.

How to Perform a Load

The load process is very similar to the dump process. First, you will probably want to create a brand new docbase. It is possible to load into an existing docbase, but depending on what is in your dump file, you may end up with conflicts in your docbase. You will then want to move your dump file onto the same server as your new docbase (in our case, adump.new). This will reduce network traffic and speed up your load process.
The first step in actually performing the load, is to run “preload”. This is another utility program that should be located on your Documentum server. It can be executed from the following command line:

preload -dump_file -script_file -U -P 
 

This performs several checks on your docbase. It may produce a script that you will need to modify and run. If so, the script is well commented and tells you what edits to make. Next, run the iapi32 application again, this time connecting to your new docbase. The following script, when executed, will perform the load process.

create,c,dm_load_record
set,c,l,file_name
c:\temp\adump.new
save,c,l 

Documentum does not overwrite objects during the load process.

It is therefore possible that you will have duplicate objects in you docbase after a load.
This is common for generic objects that are created with every docbase(such as templates).
It can also occur if you perform two loads from dump files that contain the same objects.
There is no real way to avoid this. Your only option is to manually delete the unwanted duplicates.

In our example, we specified how to set parameters on what objects are dumped from your source docbase.

If you intend to perform a full docbase dump

It is recommended that you use the following syntax:  

set c,l,dump_operation
full_docbase_dump 

Registered tables are not included in your dump (or load) process.
You must manually move and re-register these in your new docbase.

How to Clone the Content Server

We followed below steps, I am not sure whether it is best way to do it or not, but it worked for us

1. Created VMWare instance, installed content server on new VMWare host and used same repository id that of production
2. After sucessful installation, stopped all services
3. Dump the production database and load it into database used in new installation
4. Copy the %DCTM_HOME%\data directory of production repository and to data directory on VMWare host
5. Restart the server and I could able to see all data to perform tests.